1. Using Fast Parse for columns in the flat file wherever I could. 2. Using Parallel fast load in SSIS by splitting the output in 4 different streams which load the temp table.
1. Create a new SSIS package and a new Data Flow Task within the package. 2. Drag the Flat File Source adapter from the Toolbox onto the Data Flow workspace and then double-click the Flat File Source to open the Flat File Source Editor.
I'm not sure how it works so I'm looking for the right solution. I think SSIS is the right way to go but I have never used it before
Every morning, I get a tab delimited file with 800K records. I need to load it into my database:
ItemID
is the unique column in the table.Don't forget that the file contains 800K records.
ID ItemID ItemName ItemType
-- ------ -------- --------
1 2345 Apple Fruit
2 4578 Banana Fruit
How can I approach this problem?
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With