Migrate Teradata to Synapse for Retail & Consumer Goods

By migrating Teradata to Azure Synapse and replacing the Dataservices (ETL) process with Azure Data Factory, faster data transfer, lowering extraction time, enhancing system reliability, and avoiding storage triggers. It's particularly effective for managing large data feeds and improving efficiency in industries dealing with extensive data processing tasks. By using ADF, we can regroup the Extract & Load Activities/Pipelines. This change will eliminate the usage of storage triggers, making the solution more robust and improving the system's overall reliability.

Enhanced Feed Grouping: By using ADF, we can regroup the Extract & Load Activities/Pipelines. This change will eliminate the usage of storage triggers, making the solution more robust and improving the system's overall reliability.

Use of ADF Bulk API: Instead of the Dataservice, we suggest using the ADF bulk API for tier rule file extraction. It should provide a more efficient and significant improvement on data extraction process.

Our Approach

PREPARATION • Define scope • Build an inventory of data and processes to migrate • Define any data model changes • Set up the Azure target platform MIGRATION • Start small and simple • Automate where possible • Use Azure built-in tools and features to reduce the migration effort • Migrate metadata for tables and views • Migrate relevant historical data • Migrate or refactor stored procedures and business processes • Migrate or refactor ETL/ELT incremental load processes. POST-MIGRATION • Monitor and document all stages of the migration process • Use experience gained to build a template for future migrations • Test applications and query tools • Benchmark and optimize query performance