Can someone please share some links/references or guide me how to do database migration from IBM Netezza to Google's Bigquery?
I suggest you to check the data warehouse migration offer due to this process involves lots of steps such as:
Migration Strategy
Migration Plan
Effort estimation
Technical Architecture
Additional, GCP does not offer official documentation to migrate from Netezza to BigQuery; nevertheless, you can take a look into the Data Transfer Service migration documentation to get an idea of all the work that this migration implies.
On the other hand, I found some third-party companies that offers this service, maybe you can take a look there, and finally a Medium post that talks about this.
Related
I want to extract Data from my database Cassandra, and do some transformations.
I would recommend the spark connector
https://github.com/datastax/spark-cassandra-connector
In my opinion, one of the best ETL is Pentaho Data Integrator.
It is free, easy to learn, robust to use. It has a Cassandra connector since 2012, tested and well documented with tutorials and stackover flow tags.
is there any way to migrate to datomic directly from postgres..?
I have one existing postgres database i am planning to migrate to datomic
is there any source or library from where i can get help?
There's no straight-forward answer to this question or automated, general purpose tool for this. In general, ETL is not trivial, especially when moving between different types of databases (e.g. from table-backed SQL to Datomic).
That said, to get started in solving this for your case you might find Onyx, a project that transfers data to and from a SQL database (MySQL) and Datomic, to be a helpful example.
EDIT: As of December 2016, there is now a video available demonstrating a way to architecture an import job from SQL to Datomic by Stu Halloway, available here.
This is a question for most of the DBA's / Information experts at product level. I need the solution for as many different databases as possible. So please provide the details of the replication methods used. For e.g:
Database: Oracle 11i
Replication method: Oracle ODI-EE with GoldenGate
Pros: Can be integrated with any databases, etc
Cons: Cannot be integrated with so and so databases, some other generic problems
Some may have been using Trigger based or Custom PL-SQL based solutions. Please specify the problems you are facing in that scenario.
I am not only looking for CDC solutions, so please don't restrict to any CDC based solutions.
I tried searching for the solution and could not get any consolidated answer, so if this is an existing question, please share the link and feel free to close this.
I'd like the ability to create a schema for multiple database types such as MySQL, SQL Server, and PostgreSQL. I know ORM tools such as Hibernate can do this, but I won't be using an ORM to access the database so would like a solution that doesn't depend on one. Are there any tools that can do this?
Edit:
I forgot to mention that this is a personal project so I'm looking for something either cheep or free.
Take a look at Erwin.
Edit: (Based on question update)
Yeah Erwin is not going to be cheap. I did a quick search and found Toad Data Modeler, which I haven't tried but may be worth looking into:
Entity relationship diagrams - both Physical and Logical modeling (incl. inheritance)
Support for various databases (Oracle,
MS SQL Server, MySQL, Sybase Ase,
PostgreSQL, DB2)
Generation of SQL (DDL) scripts
More...
SQL Power offer a FOSS modeling tool, SQL Architect. It can generate DDL for several flavours of database. It is still technically beta (current release is 0.9.1) but it should be fine for a personal project. Find out more.
I know you said u don't want an ORM but SubSonic 3's migrations might just do the trick for you. You don't have to use the ORM just have SubSonic build itself from your database and have it as a separate class library. Then change the provider say from MSSQL to MySQL and have it rebuild itself.
PowerDesigner is a far better choice than Erwin but it too is expensive.
It took me roughly 16 hours to install the demo of Erwin, lots of failed attempts, incomprehensible error messages, help phone number which were disconnected.
PD will give you 14 day free trial.
It is a bit strange to me about database schemas sample which I think most of the projects will need to design a database for it. but when I try to find sample online, it is really rare (eg. full database schema for Inventory Management, School Management, HumanResource management). I know that each database design is depends on the project requirement, but I don't think it is much different.
I just wonder why there is so few people kick it online as other source code.
Could anyone pointing me out where to get it or any advice?
Thanks in advance
This must be the ueber-list on database schemas. And here's an interesting reading list on Amazon. I can recommend the Len Silverston books. They will get you started.
There are plenty of database schemas out there, I'd say.
SQL Server 7/2000 schipped with "pubs" and "Northwind" which you can still download from CodePlex.
SQL Server 2005 shipped with AdventureWorks, which is quite extensive and available in various versions (OLTP, OLAP, Light) - also available from CodePlex.
Many bloggers have sample databases they use for their blogs and their screencasts, e.g. Rob Bagby has one for school data and one for a winery on his blog.
There are several more (aimed at finally getting rid of using the notorious Northwind database for demos) on Codeplex.
Marc
Why not look at open source projects for schemas along with the code that use them? For CMS schemas, there're Wordpress, Drupal and a zillion others, for CRM schemas, SugarCRM etc.