I'm trying to implement an ESB in order to connect two different applications. I need to synchronize their databases, which means that once there is a change in the first database, it should be automatically reflected on the second database at the same time.
The first application (Java EE/Hibernate) has an Oracle database and the second one (PHP/Symfony2) has a MySQL DB. I'm working with Talend Open Studio for ESB V5.2.
I really need some help here especially that I'm new to this ESB thing.
To get some help on Talend Open Studio for ESB, you might want to go to tutorial pages on the TalendForge and check the Application Integration tutorials. They should help you: http://www.talendforge.org/tutorials/menu.php
Best,
Talend Data.
Related
I have a task to get Jira data into our SQL Server via an automated process. There are two options that I can think of using SSIS (it is the only approved tool offered by my company):
Make a REST API (GET request) call in SSIS. To do this, I believe I will need to write a script task which is very challenging for me because I am not a code person. There are third party plugin tools (e.g. ZAPPYSYS) to call REST API and all you need is the URI and authentication in SSIS, but I don't think my company is going to approve another paid license just for this job.
Since our on-prem Jira is connected to Postgres, I was wondering if it is a valid option to extract Jira data from Postgres into SQL Server using SSIS? Something like: https://www.mssqltips.com/sqlservertip/2619/export-data-from-postgres-to-sql-server-using-ssis/
I am still very new to databases, ETL and technology in general, much appreciated if someone can let me know my option 2 is a valid option to try, or any guidance on writing the script task code for option 1.
I am trying connect SAP ERP System with Pentaho Data Integration tools by required properties. As like below image. But didn't connect with SAP ERP System.
If I click on Test button then nothing saying. But, If I try to execute query then showing this error.
Try installing the drivers again. Below links should provide you some additional info.
https://blogs.sap.com/2014/09/04/creating-a-connection-to-sap-hana-using-pentaho-pdi/
https://www.danielpradilla.info/blog/how-to-connect-pentaho-data-integration-to-sap-hana/
The step in the background of your first screen shot, SAP ERP Table Input is not a standard Pentaho step, but a Plugin developed by IT-Novum. It is a product that has to be purchased (see here). But even that step doesn't allow direct queries using the table input step from Pentaho, it delivers its own input step. The reason is that SAP ERP doesn't allow direct database access at all, you have to retrieve data through RFC modules if you want to go through the SAP Netweaver server instead of accessing the database directly. This youtube video contains a demo around 7 minutes into the video, showing the plugin specific step.
You can use remote function modules like RFC_READ_TABLE to access tables and views with pentaho (and the sapjco library) alone, but it doesn't work through the regular Table Input step in Pentaho, you need to use the SAP Input step. And RFC_READ_TABLE has a number of limitations that make it pretty much useless for extended ETL tasks without a few modifications (see for instance this SCN thread)
If you only need to access a very small number of tables with few fields and ideally only in a few transformations, the SAP input step can help you do that. But if this a cornerstone of a large ETL process, start looking into commercial tools to help you. Or, if this is a viable alternative for you, access the database directly. But there are possible license limitations (the Oracle db licensed by SAP only allows access for the SAPSR3 user) as well as technical reasons (for instance security risks) to avoid doing that.
I have been tasked with migrating an existing MS Access database to SQL Server 2012. It appears that using the SSMA for Access is the best choice for completing this migration. I have done some review of the migration assistant and it seems to be pretty straight forward. The kicker is that this client wants to use the existing Access forms with the data that has been migrated to SQL Server. So once the migration is complete, I need to point all of the current Access forms, queries, and reports at the new data source. I am not sure of the best way to accomplish this. I see that there is an option to 'link tables' when using the migration assistant but I am guessing there is more work to do to get the entire access front end working with the SQL backend. I don't have much Access experience so any help or advice on the best way to accomplish this would be much appreciated. Thanks!
The SSMA tool can also redirect its table definitions (the entries under the 'Tables' tab in the database window) so that they reference the migrated data in SQL Server. Forms, queries and reports all use these table definitions, so you may well find that most things work as expected immediately after migration. However, there are some aspects that do not move successfully, and you are likely to hit some of these if there is much VBA code in your application.
We have an application that requires our customers to have a SQL server instance on site. At their request, the application needs to synchronize the data in their database with a copy in our datacenter.
We're using .Net 3.5 SP1. We need to synchronize the data exactly, including IDENTITY columns.
We'd prefer to use something like LINQ to SQL that would let us make some simple select and insert/update calls against mapped entities. However, the IDENTITY columns seem to be a problem with LINQ and similar approaches.
We can do this all with built-up SQL statements and turn IDENTITY INSERT on / off as needed, but I'd prefer a more elegant solution.
Thanks!
** Edit - We DO need to write our own solution, and we do need to use .Net 3.5 SP1 to do it. I won't spend your time explaining all the reasons why, but please limit suggestions to options within the .Net playground.
Microsoft Sync Framework can be your solution. This is framework description from Microsoft:
Microsoft Sync Framework is a data synchronization platform from Microsoft that can be used to synchronize data across multiple data stores. Sync Framework includes a transport-agnostic architecture, into which data store-specific synchronization providers, modelled on the ADO.NET data provider API, can be plugged in.
Sync Framework is a comprehensive data synchronization solution that enables developers to build solutions that support synchronization of any database, on any data protocol over any network topology. msdn.microsoft.com
For your convinience providing link to good tutorial on the subject
If it is just a couple of tables that need to be synchronized and there is not a lot of data in the tables (now and future) you could develop some sort of bulk copy from your servers and bulk insert routine on the customer's server.
Since you said you can't use SQL Server replication services or SSIS, then perhaps a backup/restore procedure could be written. You could take a scheduled backup of your database and make it available to calling applications which could then copy the backup, restore it to another instance on the customers server, then pull all data you need via any number of methods and it would exist locally on the customers servers.
Beyond that, I think you may be asking for a maintenance and synchronization nightmare if you can't base your solution on tools that are made to do this sort of thing.
I have a client asking me to migrate his Sybase application to web. I have worked on PHP/MySQL, C#/Ms-Sql but never worked with Sybase platform!
Please suggest me some ways i can go through this. How would we migrate existing Sybase desktop application to web application?
Thanks in advance.
It's possible to have a sybase database online.
With a simple search on google you may choose the site that you need :)
Now, to pass all the database info (tables and content, sps, etc.) for the remote database you'll need to do two things:
Use ddlgen batch to extract all the tables/views and stored procedures code.
Use bcp to extract all the info from the tables.