I am trying to set up an FTP task in SSIS. The source is not variable. The destination folder is predefined. However, I need the received file to be renamed.
LDAP.txt after fetching needs to be LDAP_20140204.txt in my target folder. on using variables, it throws the error
'Directory is not specified in the file connection manager'
Any work around for this?
Have you considered the File System Task? This will allow you to rename a file. http://technet.microsoft.com/en-us/library/ms140185.aspx
Related
SSIS File System Task can copy but can't move the flat files?. I am trying to move the flat files from source to target folder but FST only working for copy. and while moving it throes and error saying that, file is being used by another process. I have tried using delay's also it doesn't work.
By default, File System Task can perform Move operations as mentioned in the link below, but make sure the the flat file is not used in a Flat File Connection Manager since it will lock the file for reading or writing and it will prevent the FST to perfrom a move operation.
External Links
Move File Using File System Task in SSIS
Move Directory Using File System Task in SSIS
i have FTP created inside Default FTP Site on one server name A and trying to copy files from other server B and trying to place in Server C through batch script, which is configured in A as physical path, i can see transfer is happening but its going in root folder of A which is not correct. Please suggest me what code i need to write in batch script which can place file on sever c.
If you want to keep directory structure, you can compress to zip with directories and unzip at target. This may also reduce file transfer load. But if you wanna make it one by one, in the batch file, store full path and check full path at target. At target, create full path and copy file if path exists.
I'm using this link as a reference for reading a file from FTP folder. But this tutorial says that the files in the FTP folder should be loaded in a local folder and only then it can be used for processing using other tasks in SSIS.
My question is, Is it possible to read a file directly from the FTP folder without storing them in the local folder and do the ETL operations in SISS?
Any advice would be helpful, Thank you.
Not with standard SSIS components. Standard SSIS allows you to download a file from FTP server to a local folder, and use local CSV-like file as a data source. Standard Flat File Source or XML Source allows only local and mapped network folders as sources for the source File.
If you really want to combine FTP download and Data source in single data source, you can write your own Script Source Component with C# or VB.NET. It will require more efforts than using standard two components.
In the BW Designer, File Poller can look for file in the local server where the Designer is installed.
But If I want the File Poller to look at another server instead of the local server, I don't see any option to do that.
Is there any other way so that I can use File Poller to look on any other server and poll file from that server instead of the server where the Designer is installed?
Thanks
The File Poller can only access files and directories visible to the system the engine is running on, so you need to mount a network drive to poll files sitting on a remote server.
Another option would be to build a custom polling mechanism using the FTP Palette. You could use a Timer instead of a File Poller. On the first execution, the process would list the files in the remote folder using the FTP Dir activity then store this list in a Shared Variable. This list would contain the file names, last modification dates, etc.
Every time the process is triggered, it would run FTP Dir to compare the current list of files against the previous one to detect any changes (new files, modified files, etc.) then update the Shared Variable to keep the latest image of the remote folder. You could then run FTP Get to retrieve any new or modified file.
I have one SSIS package that has FTP task which takes files from FTP and save on my local drive but i'm getting this error:
[FTP Task] Error: Directory is not specified in the file connection manager "User::ProcessingFileLocation"
In FTP Editor setting :
User::ProcessingFileLocation used SSIS variable
Values sets to this is \\MYSERVER\\Raw Data\\
Why getting this error any solution
When i mention direct path it is working fine but having error with variable :(
Another solution to this problem might be the one that affected me.
The FTP task does not create the path specified in the LocalVariable, make sure to manually create the destination folders.
override the UNC path with local path in Integration Services Catalog, connection manager. Right click on the project and choose configure