I currently have a Postgres DB (10.12) running in a docker container on a EC2 instance. I want to migrate the entire DB to RDS. What's the best way to do it? The additional docker container is complicating things. Not sure if I should use the AWS DMS or pg_dumpall command.
Related
I'm trying to use impdp on RHEL without GUI. I'm not sure if my direction is correct. Since RHEL has no GUI, so what I do is install SQLcl from https://www.oracle.com/tools/downloads/sqlcl-downloads.html
Basically my objective is to migrate on-premise oracle database to RDS and this RDS can only be accessed by particular EC2 instance. In other words, I would need to find a way to perform Data Migration by SSH into this EC2. Wondering if anyone can shed some light on whether my direction is correct? Or is there any simpler way to do it?
Importing Data into Oracle on Amazon RDS
You do not have direct access to the RDS instance file system.
There are several data migration solutions.
The first solution using S3 Bucket.
Export data from the premise database using expdp.
Upload the dump file to the S3 cloud.
Copy Dump File from Amazon S3 Bucket to the RDS instance.
Use DBMS_DATAPUMP to Import the DUMP File on the RDS Instance.
The second solution using Database Link.
Export data from the premise database using expdp.
Create a Database Link to the RDS Instance.
Use DBMS_FILE_TRANSFER to Copy the Dump File to the RDS Instance.
Use DBMS_DATAPUMP to Import the DUMP to the RDS Instance.
The third solution using Oracle XE, if you cannot make a db link between your DB and RDS instance.
Export data from the premise database using expdp.
Create a free instance of EC2(1 CPU core, 1G RAM, 30GD HDD ) or a
paid instance with a large disk and CPU.
Install a free database version of the Oracle XE version on EC2 instance.
Copy files to the DUMP directory to Oracle XE on EC2 instance via the sftp protocol.
Create a Database Link to the RDS Instance Use DBMS_FILE_TRANSFER to
Copy the Dump File to the RDS Instance.
Use DBMS_DATAPUMP to Import the DUMP to the RDS Instance.
And other solutions without using DATA PUMP:
Importing Using Oracle SQL Developer.
Oracle Original Export/Original Import Utilities
Oracle SQL*Loader Oracle Materialized Views using db link
We have 2 SQL Server databases. One of them is to be moved to AWS cloud.
Is Amazon RDS the ONLY approach to move the SQL Server to AWS?
What is the best way to automate data transfer of table data from the SQL Server that IS in the cloud to the SQL Server that is NOT in the cloud?
The volume and complexity of data is not high in our case. We need to migrate only ONE table and we'd like to automate it to run every night.
Would AWS Glue be useful for this? Would it help in loading data from INSIDE the cloud to OUTSIDE?
I also just found DMS - https://aws.amazon.com/dms/
But the homepage says "Migrate your databases **to** AWS with minimal downtime"
Can I do the opposite with DMS? Can I migrate data **FROM** AWS to outside AWS?
Amazon RDS is not the only approach to host SQLServer in the cloud. You can use an EC2 instance and install SQLServer manually. This could make sense in case you want to have sys_admin privileges. But be careful, as you would have to do patching all by yourself. I would not recommend doing that.
DMS is a good way to migrate your data every night. The service you are looking for is continuous data replication from DMS. Glue can also be used for this task. Glue's purpose was never to do database replication. Hence, it could be a pain monitoring the replication & debug in case of errors. That is why I would recommend DMS.
I am currently working on a project where I use Postges inside a Docker and manage it via Flask-Migrate but only during development.
My goal is to use a database directly on a VPS in production.
Can I create migration scripts on the Docker databse and then copy them to run on the VPS database?
Your migration scripts will be stored with your source code, not inside the Docker container where the database is. So it really does not matter, as long as you set the database connection URL properly you can generate and apply the migrations on any supported database, be it hosted on a container or a VPS.
I have doubts on SQL server with docker. If i have multiple MS SQL DB containers are running in my host, and it was accessed by the same Application with load balance. how the data base will replicate with in the containers ( Live). can we use SQL Replication for this. Kindly suggest on this. i am new to this .
Regards,
Karthick V
I followed the excellent tutorial on
http://www.jakusys.de/blog/2008/09/grails-and-liquibase-how-to-use/
in regard to my dev database on local machine where grails is installed. All went well.
Now I want to deploy grails war to remote website where I setup mysql on remote server.
But I am at loss now. How do I apply the command:
grails migrate
so that the now the remote database has the DATABASECHANGELOG table.
In the database there is some production data that I will manually copy from my local mysql to fresh install of remote mysql database while most of other tables are fresh and have no data. I am waiting for reply to this question to make sure I don't mess up something before actually launch my grails application on remote production server.
You can migrate a remote DB from your computer, using grails.env variable, like:
grails migrate -Dgrails.env=production