I am trying to replicate the source database (Oracle 11g and MS SQL Server 201x) to Azure SQL Database. Initially I thought of using Azure DMS(Database Migration Service) to do a full load + Change Data Capture for changes. After started to work on this, I learnt that the DMS requires Control Server privileges on the SQL Server Database and DBA Role on Oracle. We might not get these permissions on the source databases as they are managed by third party company (SaaS model). However, we have read permissions on the source database/tables.
We have to achieve the following :
Replicate data from Oracle Source System to Azure SQL Database and
Replicate data from SQL Server 201x to Azure SQL Database.
What should be the approach?
Azure SQL Data Sync? I read on the forum that it actually writes/creates tables in the source database. This won't be acceptable.
Transactional replication for SQL Server? - Has any one tried? Can you please share your experience?
Third option I thought was to use Attunity Replicate (however, not sure about the licensing costs)
Can someone please help with approaching this business problem?
Regards,
JE
You said, you have read permissions on the source database/tables(Oracle and SQL Server). I suppose that you just have the read-only permission.
Then the answer is no, we can not copy the data or migrate the database(Oracle and SQL Server) to Azure SQL database without the CONTROL SERVER permission.
Data sync can help you sync the data from SQL server to Azure SQL database, but you need have permission to Azure SQL too. Create the table with same schema and so.
If you don't the permission on SQL server, the Transactional replication also doesn't work.
For Attunity Replicate, I don't know much it, sorry that I can't answer you.
For your questions:
1.Replicate data from Oracle Source System to Azure SQL Database
Please reference this Azure Database Migration Guide: Migrate Oracle to Azure SQL Database.
This scenario describes how to migrate an Oracle instance to Azure SQL Database.
2.Replicate data from SQL Server 201x to Azure SQL Database.
Reference: Azure Database Migration Guide:Migrate SQL Server to Azure SQL Database.
This scenario describes how to migrate a SQL Server instance to Azure SQL Database.
We also could use bellow way to migrate the database with SSMS:
Create a dacpac file and import to Azure SQL.
SSMS Deploy database to Microsof Azure SQL database.
For details, please see: Learn how to Migrate a SQL Server database to SQL Azure server.
Hope this helps.
Related
I'm trying to migrate all the old databases from SQL SERVER to AZURE SQL Database using Database Migration tool and successfully able to do.
There are more than 100 databases to migrate so for each and every database running the tool and repeating the process is lot of process.
Can someone help with migrating Multiple databases in one go or doing one at a time is the only solution.
Thanks.
You can only select a single database from your source to migrate to the Azure SQL database using the Data Migration Assistant tool.
You can create an Azure Database Migration Service resource in the Azure portal and select one or more databases to migrate from SQL Server to Azure SQL Database.
Refer this Microsoft documentation for detailed process.
I'm trying to build daily ETL process from Azure SQL Database to on-premises SQL Server data warehouse.
I have experience in ETL between on-premises SQL Servers but when it comes to Azure I'm not sure the best practise. I did some researches and got the options on ETL and ADP.
Would anyone here have similar experience before, could shed me some lights? Any comment, example or tutorial are much appreciated.
There are many ways can help you build daily ETL process from Azure SQL Database to on-premises SQL Server data warehouse.
I would suggest you think about Azure Data Factory or Azure SQL database Data Sync.
Data Factory can help you build a pipeline to copy the data between Azure SQL database and On-premise SQL Server. You could create a time trigger to trigger the copy daily. Ref these documents:
Copy and transform data in Azure SQL Database by using Azure Data
Factory
Copy data to and from SQL Server by using Azure Data Factory
Data Sync is a feature of Azure SQL database, you can sync the data between SQL database and on-premise SQL Server automatically. I think that's the easiest and cheapest way which can achieve your request in some way. Just note the requirements and limitations.
And like #Nick said, Azure SQL database doesn't support windows authentication, please use SQL authentication or AD.
HTH.
When I use SQL server 2017 database tool to upload my database, I got this error.
When I generate .bacpac file by myself and upload to azure storage account, then import to azure sql server, I also get the same error.
This database is generated from my asp core project using Entity framework, I generate to sql server 2017 to add more performance update like: partition table, indexing table. After that, I upload this database to Azure cloud, then I get this error.
Please help me!
Please try to remove the login Admin at the database level before trying to migrate to Azure SQL Database again. Admin is not a valid login name you can use in Azure SQL Database.
I usually recommend users to use Azure Data Migration Assistant (DMA) to migrate a SQL Server database to Azure SQL Database, because it performs an assessment first and let you know things you need to fix prior to migrate to Azure SQL. Once all incompatibilities are fixed, DMA allows you to migrate with a couple of clicks.
I'm having issues deploying databases to SQL Azure DB from SQL Server Management Studio using the Tasks > "Deploy Databases to Microsoft SQL Azure" option path. I notice this tends to fail if the database has views. Is this a well-known issue or am I doing something wrong?
Please consider not using SSMS and use Microsoft Data Migration Assistant (DMA) instead. DMA is the easiest way to migrate a database to Azure SQL Database. It gives you an assessment of the database and tells you about possible blocking points and existent incompatibilities of the database with Azure SQL Database. You can download DMA from here.
We have two SQL Server Database (EG: DB1 & DB2) that are hosted in NON-Azure environment (dedicated server). We are planning to migrate DB1 to Azure SQL.
Is there way the Azure SQL DB1 can talk to non-azure DB2 using Linked Server approach? I want to query in my Azure SQL (DB1) and get the data of DB2.
If I understand correctly you are trying to connect your Azure-db (DB1) from an on-premise db (DB2). From on-premises SQL Server, you can use linked servers and 4-part names to point to a database in Azure SQL DB using a datasource which would look like this -
[YourAzureServerName#database.windows.net].[YourDatabaseName].[YourSchemaName].[YourTableName]
For more details please check this link.
Yes you can certainly do that.
This atricle explains all the details that you need to do to accomplish that:
https://www.mssqltips.com/sqlservertip/3630/connect-an-azure-sql-database-to-an-onpremises-sql-server/
Note that your SQL Azure instance needs to be in "Standard" service tier to be able to do that.
If you want to add your SQL Azure server as a linked server to your on-prem SQL you can use ODBC connection.
Bellow MSDN article will help you with that:
https://blogs.msdn.microsoft.com/sqlcat/2011/03/07/linked-servers-to-sql-azure/