Automated FTP to upload new files to web server? - file

I'm looking for a FTP client that I can use to upload new files from a local development machine to a remote web-server. I only want to upload the newly edited files though.
Is there a command line utility that can do this, that I can add into an automated process? Is there a GUI client available that can do this? Would be nice to have it cross-platform too. Any ideas?

The Mercurial FTP Extension should do this for you, although I haven't tried it myself.

There is a 'backup' program called SyncBack that does this.
You can find out more about it here: http://www.2brightsparks.com

You have two options:
Schedule a frequent synchronization of a local folder against a remote folder (or moving all files from local folder to a remote folder, if that's more appropriate)
Use a tool that can watch for changes in a local directory and reflect them on a remote directory
You can implement both these options with WinSCP FTP client.
Scheduling
To synchronize changes in a local directory to a remote directory, use the WinSCP synchronize script command from a batch file like:
winscp.com /ini=nul /log=c:\writable\path\to\synchronize.log /command ^
"open ftp://username:password#ftp.example.com/" ^
"synchronize remote C:\local\path /remote/path" ^
"exit"
And schedule the batch file to be run frequently using Windows scheduler.
If you do not want to keep a local copy of the images, just move them to the FTP server, instead of synchronizing them. For that, replace the
"synchronize remote C:\local\path /remote/path" ^
with the put -delete command like:
"put -delete C:\local\path\* /remote/path/" ^
For details see also a guide to automating file transfers (or synchronization) to FTP server.
Watching for changes
Use "Keep remote directory up to date" function of WinSCP.
It can be used both in command-line/console mode using the keepuptodate command, like:
winscp.com /ini=nul /log=c:\writable\path\to\synchronize.log /command ^
"open ftp://username:password#ftp.example.com/" ^
"keepuptodate C:\local\path /remote/path" ^
"exit"
Or in a graphical/GUI mode. You can launch the graphical mode in WinSCP GUI (after logging in) or from a command-line using the /keepuptodate switch like:
winscp.exe ftp://username:password#ftp.example.com/ /keepuptodate C:\local\path /remote/path
(I'm the author of WinSCP)

Related

WinSCP - Download file from SFTP server to network location, then delete

I need to write a WinSCP script or batch file that will download the contents of a remote SFTP folder, delete contents and then upload to a mapped network folder. I know how to write the login part of the script. But I am confused as to what the specific command line should look like. From what I've read the command script to download and delete the file is something like this:
get -delete -transfer=binary *
The part that I'm not getting is the upload to the network folder command. I understand put is the WinSCP upload command operator. But how do I use it in conjunction with the network folder location files should be uploaded to? Also, can this be scripted out in a batch file or do the batch file and script need to be written separately? Thanks!
An "upload" to a mapped network folder is not a job for WinSCP. A mapped network folder behaves as a local drive. A plain Windows copy command will do. So first do your WinSCP download and then copy (it's not really called an upload) the files to the network drive.
winscp /ini=nul /command ^
"open sftp://user:password#example.com/" ^
"get -delete /sftp/path/* c:\local\drive\path\" ^
"exit"
copy c:\local\drive\path\* n:\mapped\network\drive\path\
Though, if you do not need the files locally, you can have WinSCP download the files from the SFTP folder directly to the mapped network drive:
winscp /ini=nul /command ^
"open sftp://user:password#example.com/" ^
"get -delete /sftp/path/* n:\mapped\network\drive\path\" ^
"exit"

How to change remote directory location to a path out of SFTP root in WinSCP

I am SQL DBA using WinSCP command line in SSIS package to download backup file from SFTP server.
My default remote directory on the server is C:\sftp_root, which I can see in WinSCP as /. But my backup files is at D:\Backup folder. I can't keep my backup file on C drive as it's having space issue.
I am using below command line using WinSCP.com in my SSIS package to download the backup file. When trying to change my remote directory, I am getting an error "No Such file exists".
/log=D:\DBA\winscp.log /console /command "option batch abort" "option
confirm off" "open sftp://sftp_dba:Password#2.2.2.0:22
-hostkey=""ssh-rsa 2000 2s:2g:44:12:56:ws:ss:as""" "cd /D:\Backup" "get *.bak D:\Backups\" "rm *.bak" "exit"
First of all I am wondering if it is possible to change remote directory path in the above command line? If yes, please help me with the syntax.
I am stuck here and need experts help.
Thanks in advance.
What path(s) on the server file system you can access with SFTP protocol is a matter of configuration of the SFTP server.
If the SFTP server is configured to map only C:\sftp_root to SFTP root path / (aka to jail your account to C:\sftp_root), there's no magical way for you to circumvent that (escape the jail).
You have to reconfigure the SFTP server to allow an access to a different path.
E.g. you can map the D:\Backup to /backup.

Downloading new files from FTP server to Windows in a batch file

I am writing a batch file that downloads files from an FTP server.
Now, I want these files to be checked against the existing files, so that they are not being downloaded again. There are multiple files being downloaded and I do not know the name of the files that may be present in the FTP server.
Thanks
Just use any Window command-line FTP client that supports synchronization.
For example with WinSCP FTP client, you can use a batch file like:
#echo off
winscp.com /ini=nul /log=synchronize.log /command ^
"open ftp://username:password#ftp.example.com/" ^
"synchronize local C:\local\path /remote/path" ^
"exit"
References:
Guide to automating synchronization from FTP server;
Scripting command synchronize.
You can have WinSCP GUI generate a batch file template for you.
(I'm the author of WinSCP)

Batch file - Download the latest FTP folder

I'm trying to download the latest folder from an FTP server. This folder contains several folders in which contains several CSV files.
The issue I have is that the folders are created each day and each time I run the script I only want it to download the latest folder at that location.
I have not the foggiest idea of how to specify this, or even download an entire folder structure from an FTP using batch file.
Please let me know if any additional information is required and I will provide it immediately, thanks again for your help.
Kind Regards,
Lewis
There's no easy way to select the most recent folder with the built-in Windows FTP client, the ftp.exe. You would have more luck with a PowerShell script and the FtpWebRequest.
But even if you manage to select the most recent directory, neither the ftp.exe nor the FtpWebRequest support recursive downloads anyway.
You better use some more powerful 3rd party FTP client.
For example with WinSCP FTP client you can download the latest file or folder, using the -latest switch of the get command (WinSCP 5.9 and newer):
winscp.com /command ^
"open ftp://username:password#ftp.example.com/" ^
"cd /remote/path" ^
"lcd c:\local\path" ^
"get -latest *" ^
"exit"
See also the guide to downloading the most recent file with WinSCP.
(I'm the author of WinSCP)

Automatically upload new files added in multiple directories to FTP

I am trying to do some automation in uploading new files to FTP that were added in local directories to the same directories in server.
Is there anyway I could make that possible? Please help me out. I will be grateful.
Thank you!
Just use any command-line Windows FTP client that supports synchronization.
For example with WinSCP scripting, you can use its synchronize command:
winscp.com /log=ftp.log /command ^
"open ftp://username:password#ftp.example.com/" ^
"synchronize remote c:\local\path /remote/path" ^
"exit"
And depending on your requirements, either loop the batch file or schedule it in Windows scheduler.
For real-time synchronization, you can also use the keepuptodate command.
winscp.com /log=ftp.log /command ^
"open ftp://username:password#ftp.example.com/" ^
"keepuptodate c:\local\path /remote/path" ^
"exit"
(I'm the author of WinSCP)

Resources