I have tab delimited csv's with UCS-2 LE encoding that I need to import to SQL using SSIS. I intend to bring multiple files in using SSIS and parse to various tables and columns either within SSIS (preferred) or in SQL. I am using 65001 (UTF-8) code page on the flat file connection, "Unicode" is checked because we have some special characters in the file.
In the preview page, I can see what appears to be my tabs in the source file. However, when I use the flat file connection as a source, the tabs become spaces in the output, whether to a table, or to another flat file.
Is there a way to import UCS-2LE csv's as ragged right and retain the tabs in the output column?
This question is related to my previous question but is different in focus, so I'm creating a new question. I have a CSV file that has only column names in it, no data. I've created a Flat File Connection Manager in SSIS using Visual Studio 2012. I've checked Column Names in the first data row in the Connection Manager. Two column names must end in periods (Employee No., and Hrs.). Those columns are present with the periods in my CSV file. Comma, not period, is the delimiter in the Flat File Connection Manager. However, when I point the Connection Manager to the CSV file and click on Columns in the Connection Manager, the periods are replaced by spaces. Further, if I create a Flat File Destination, point it to my Flat File Connection Manager and run my SSIS package, the column names have spaces instead of periods. Is this a bug or am I doing something wrong?
Open the Flat File connection manager, Go To Advanced Tab and change to columns names (Add periods instead of spaces)
Similar question
Add Special Charachter in SSIS Flat File Column Header
How can I load BAI2 file to SSIS?
.BAI2 is an industry standard format used by the banks. Below is the one truncated example
01,021000021,CST_USER,110520,1610,1627,,,2/
02,CST_USER,089900137,1,110509,1610,,2/
03,000000370053368,USD,010,782711622,,,015,7620008 12,,,040,760753198,,/
88,043,760000052,,,045,760010026,,,050,760000040,, ,055,760000045,,/
Use a Flat file connection manager
I think you can import these files using a flat file connection manager, because they are similar to comma separated text, try to change the row delimiter and column delimiter properties to find the appropriate one.
From the example you mentioned i think you should use:
, as Column delimiter
/ as Row delimiter
To learn more about how to interpret a BAI2 file check the following link:
EBS – How to interpret a BAI2 file
Based on this link:
The BAI2 file is a plain text file (.TXT Format), which contains values / texts one after the other.
Because the number of columns is not fixed among all rows than you must use define only one column (DT_STR,4000) in the flat file connection manager, and split columns using a Script Component:
SSIS ragged file not recognized CRLF
how to check column structure in ssis?
SSIS : Creating a flat file with different row formats
Helpful links
SQL SERVER – Import CSV File into Database Table Using SSIS
Importing Flat Files with Inconsistent Formatting Using SSIS
SSIS Lesson 2: First Package
I would like to use SSIS variable as a part of my header row in flat file destination. Is there a way to do that?
Use a script component in the control flow to add the header to the empty file and then have your data flow ignore headers.
I have been trying to export the output of a SqlServer sql query (stored procedure) to a text file.
I achieved it using a Data Flow task with an OLEDB source and a Flat File Destination.
I would also like to get the Column headers along with the query result in the text file , but I cannot figure out how I can include the column headers.
I would like to do this dynamically from within SSIS
Is there anyone who knows how to do this ?
OLEDB Source, coonect the database. Use a table or preferably a SELECT statement (not select *, as you are aware, I am sure).
Flat File Destination. Connect them together. In the Flat File Destination Editor, click New... Select Delimited (for example). Give a File name. Say C:\temp\a.csv. Check mark Column names in the first data row.Click on Columns section in the left pane. You should see your column names. You can change these names in the Advanced section. Now, go to the mapping coulmn, and map the columns.
Special Note: Do not use a select statement in a stored proc as your data source. Ref: http://www.jasonstrate.com/2011/01/31-days-of-ssis-no-more-procedures-2031/
Please respond back.