End-to-end Azure Data Factory pipelining: 2-Wk POC

Would you like to evaluate Azure Data Factory to manage and engineer your data? Look no further. Our implementation POC will give you peace of mind in the space of 2 weeks, during which we will help you developing an end-to-end transformation data factory pipeline, from the data source ingestion to inserting data into the target DWH, in three key steps:

Step 1: Read from files stored in Azure Data Lake Store.

Step 2: Perform the Data Transformation from files. The business logic is migrated from transformation job chosen by the client.

Step 3: Write the results of the transformation in a table of the persistant storage Azure SQL Server database that acts as the DWH.

The tasks that our consultants will perform together with you are:

• Requirements gathering: We will work together to identify the most adequate data pipeline to migrate to Azure
• Cloud setup: Creation and deployment of Azure services: Data Factory, Data Lake Store and SQL Server database service. User permissions setup
• Service configuration and integration: Azure services configuration and integration of service. Creation of Linked Services in Azure Data Factory
• Development: Data Factory origin and destination datasets creation; database table creation
• Migration: Lift-and-shift of the SQL business logic
• Validation and Test: End-to-end pipeline testing and data validation
• Presentation: Outcome of the PoC presented, review migration approach and work on next steps