Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Module or tool for web-based data import and ETL? [closed]

I'm going to be adding a feature to a web application that allows users to import data. I don't want to reinvent wheel, so I am looking for any module I could integrate that would handle this.

The interface should be similar to that of importing a file into Excel or Access plus some more complex mapping and type conversion functions typically found in ETL software.

General Flow:

  1. Upload a file (CVS, Excel, etc.)
  2. Preview the data in the file -- use the first row as column names and then show the first N records so the user can verify the file was parsed properly
  3. Show a mapping interface to select how the source columns match to the destination
  4. Process the import and validate the data
  5. Provide report of data that failed import with option to download a file of just the failed rows
like image 231
cope360 Avatar asked Nov 14 '22 13:11

cope360


1 Answers

Not sure there is a single module out there, but here are some pretty cool tools to accomplish at least parts of this:

  1. File Uploading
  2. CSV Parsing

Other than this, phpMyAdmin offers is one of the best web-based Database managers (for MySQL databases).

like image 185
Brandon Boone Avatar answered Jan 24 '23 01:01

Brandon Boone