I have one requirement, where I need to move multiple files present in one folder to another. This should be done based on filename which should be dynamic.
As Far I have tried out pollenrich and file (antInclude) but in both case I got struck.
<route id="readFile" autoStartup="true">
<from uri="timer://timer1?repeatCount=1"/>
<setHeader headerName="xxx">
<simple>1234</simple>
</setHeader>
<pollEnrich timeout="15000">
<simple>file://{{baseDirectory}}?move={{destinationDirectory}}&antInclude=*_${header.xxx}.txt</simple>
</pollEnrich>
</route>
Note: Header value will be dynamic, using javascript will pull that data and set it in header.
Any help on this would most welcome.
Thank you for all your response,
I achieved it by using pollenrich but tweaking something in pollenrich.
Got CamelBatchsize using pollenrich.
Running into a loop using size.
Using the above code used to move the file. I achieved it.
Thanks.
Related
I need to read pair of files with same name but different extension in same directory say for example
1. abc.json
2. abc.signed
above files should be sent same camel exchange, where value from abc.signed is used to validate the abc.json file.
Please advise !!!
Use pollenrich to read both kind of file in a single route and then perform validation within that route.
<pollEnrich timeout="5000"><simple>file://pathto//yourfile?antInclude=*.json&noop=true</simple>
</pollEnrich>
<setHeader headerName="JSON">
<simple>${body}</simple>
</setHeader>
By doing so, you can able to get both json and signed values.
I have an Apache Camel route which purpose is to fetch xml-documents and files linked in the document.
<route id="route-ftp">
<from uri="ftp://foo#server:21/data?password=xxx&include=.*.xml"/>
<to uri="myBean"/>
</route>
When it reaches myBean I want to parse the file and use the same ftp settings to fetch the files listed in the xml-file.
Or perhaps fetch them all at the same time using xpath.
<root>
<article>
<headline>Headline</headline>
<image src="images/cat.jpg"/>
</article>
</root>
The filenames is taken from the above xml image tag and src attribute.
I then want to deliver the original file together with my images in a package.
I can't find the right approach to my problem.
I would probably do it this way.
Depending on how your file is structured, I would consume it as you have done. I would then split the body per row (assuming each row contains a filename). The split is done using the splitter EIP. Now each body contains the file name.
I would then use Camel's dynamicTo to enrich the route with the file using the ftp parameters. You can save the ftp parameters are properties so that they are always the same.
In this way, you fetch the list, iterate over the list and fetch the file for every row in the list.
I run an automatic route when files are dropped in a folder
<route id ="automatic-route">
<from uri="file:C:/pathToFolder?noop=true"/>
<to uri="bean:automaticBean"/>
<to uri="activemq:STARTFLOW.Q"/>
</route>
I move the file in a subfolder called "done" with java methods in my Bean AutomaticBean.java.
Then I start another route to process the file.
<route id ="process-route">
<from uri="direct:process"/>
<to uri="bean:processBean"/>
</route>
When I move multiple files in the folder they are correctly moved to the subfolder (through my Bean. I use java method to move them). But then the second bean (file processing and SQL queries) has timeoutException because the files are moved and processed at the same time.
For example when I move 5 files 3 of them are correctly processed but then the last ones have a timeoutException. Is it possible to run the second route for each files one by one (schedule them or something like that)? And only start the second route for a file when the previous file is correctly processed?
I tried with noop=false;move=done and I have infinite loop problems and I cannot process the files because they moved. That's why I use noop=true. Furthermore my problem is about the second route (the files are all correctly moved).
Thanks.
One solution can be to poll the /done folder for the new files (which have been processed and moved by your automaticBean). In this case you have to use readLock or doneFileName to check if the file isn't locked by another process.
<route id ="process-route">
<from uri="file:C:/pathToFolder/done?readLock=changed"/>
<to uri="bean:processBean"/>
</route>
Actually adding a delay an set maxMessagePerPoll to 1 did the trick
<route id ="process-route">
<from uri="file:C:/pathToFolder/noop=true&delay=10000&maxMessagesPerPoll=1"/>
<to uri="bean:processBean"/>
</route>
I have some problems using a filter attribute in an sftp-endpoint containing few symbolic links. My route looks as follows:
<route id="test1">
<from uri="sftp://myhost/../../my_storage/dir_with_symlinks?username=user&password=mypass&recursive=true&stepwise=false&filter=#MyFileFilter"/>
<to uri="file:/tmp/sftp/myout"/>
</route>
In MyFileFilter.accept(GenericFile<T> file) I get only all linked directories as RemoteFile<T> but the files in it won't be seen.
Obviously, I am missing some part of code. Any idea how could I solve the problem?
In Camel, is there any way to rename a file after a set period of time, using the Timer component and a Spring configuration, if the file already exists?
Is it only achievable by having a Timer route that calls a Java method that will rename the file?
So, I have a socket I want to pull data from. The data flows all day, every day. Because of that, I do not just want to keep routing the data into one specific file.
So my thought process led me to just rename the existing file after X period of time and let the Netty route create a new file since it wouldn't exist anymore after the renaming.
I have a route similar to:
<route customId="true" id="socketToFileRoute">
<from uri="netty4:tcp://localhost:9999?clientMode=true&textline=true" />
<transform>
<simple>${in.body}\n</simple>
</transform>
<to uri="file://data?fileName=socketData.txt&charset=utf-8&fileExist=Append"/>
</route>
Is there a way to set up a Timer route along the lines of the following?:
<route customId="true" id="dataFileRenamer">
<from uri="timer://renameFile?fixedRate=true&period=50"/>
<to uri="file://data/socketData.txt?rename the file created in the previous route" />
</route>
You don't need a timer or anything complex, you should just use toD (Dynamic To endpoint):
<route customId="true" id="socketToFileRoute">
<from uri="netty4:tcp://localhost:9999?clientMode=true&textline=true" />
<transform>
<simple>${in.body}\n</simple>
</transform>
<toD uri="file://data?fileName=socketData-${date:now:yyyyMMddHHmmss}.txt&charset=utf-8&fileExist=Append"/>
</route>
This will resolve the endpoint dynamically for each message, resulting in a new file being generated each second, or whatever period you want to use.
You cannot rename the file, at least not that I am aware of. You could via the timer node enrich your route by reading content of the existing file using the .enrich() syntax and then create a new file with a new timestamp. A rough example:
.from("timer://renameFile?fixedRate=true&period=50")
.enrich("file://pathtofile?fileName=<filename>")
.to("file://pathtofile?fileName=${file:name.noext}-${date:now:yyyyMMdd-HHmmss}.${file:ext}");
Something along those lines. Off course this means you generate a new file for every period. If you really want to rename, then I guess you would have to create a processor class and use the standard java API to see if you can consume and rename it.