Tiger Data Fabric: Accelerator for Implementing Data Lake & Data Fabric on Microsoft Azure

Tiger Analytics

Tiger Analytics' accelerator for Implementing Data Lake & Data Fabric on Microsoft Azure in a highly scalable manner with powerful low code/ Self-Service & Governance capabilities at its core

Tiger Data Fabric is developed by following various industry best practices and using proven Azure PaaS & Open-Sourced Big Data services. Some of the key features include:

  1. Agility with Self Service: Cuts down the time it takes for setting up new Data Pipelines from Days & Weeks to Few Minutes. Leverage different interfaces like Chatbot, Automation Scripts, REST APIS and a modern Web UI for managing the entire data platform and configure new data pipelines.

  2. Medallion Lakehouse Architecture: Follows Data Engineering Best Practices & based on Medallion Lakehouse Architecture by organizing the data in Bronze, Silver & Gold layers.

  3. Scalable Cloud Architecture: Highly Scalable & Service Oriented Architecture, developed using different Azure PaaS & Open-Source Big Data Technologies.

  4. Transformation Capabilities: Capabilities to perform various data Transformation Operations like data cleansing, validation, quarantine, auto-profile & target merge – in a highly configuration driven manner. Integrated DBT Module for implementing governed transformation pipelines.

  5. DE Virtual Assistant: An integrated virtual assistant (powered by Microsoft Bot framework and LUIS) that provides capabilities for setting up ingestion pipelines, tracking jobs, evaluating data quality etc. – all over a simple chat interface.

  6. Knowledge Graph & Intelligent Search: Integrated with Knowledge graph & Search Index to provide intelligent Data Catalog capabilities (for both metadata and lineage).

  7. Data Quality: Great Expectations based Data Testing framework to validate onboarded datasets for consistency and user defined rules.

  8. Additional Governance Capabilities: Powerful framework for logging, notification & alert, and azure cost monitoring features.

  9. DevOps: Powerful Infrastructure as Code capabilities with single click deployment via CI/CD pipelines.

Technologies Used: Azure Data Factory, Azure Databricks, Azure SQL Server, Azure Data Lake Storage Gen2, Elastic Search, Azure Key vault, Azure DevOps

https://store-images.s-microsoft.com/image/apps.3906.f54df420-5c50-430c-9594-4b00160d43f3.cdd3f433-7db1-4b86-b06e-93720a587c1a.8076d0a1-c1c8-4b07-b855-3a821a95ae65
https://store-images.s-microsoft.com/image/apps.3906.f54df420-5c50-430c-9594-4b00160d43f3.cdd3f433-7db1-4b86-b06e-93720a587c1a.8076d0a1-c1c8-4b07-b855-3a821a95ae65
https://store-images.s-microsoft.com/image/apps.21209.f54df420-5c50-430c-9594-4b00160d43f3.cdd3f433-7db1-4b86-b06e-93720a587c1a.556fdd4b-97e7-4673-aaea-cbb1067bae66
https://store-images.s-microsoft.com/image/apps.20884.f54df420-5c50-430c-9594-4b00160d43f3.cdd3f433-7db1-4b86-b06e-93720a587c1a.93dcfa65-783a-423d-9b8b-3ea5d7ac2326
https://store-images.s-microsoft.com/image/apps.27441.f54df420-5c50-430c-9594-4b00160d43f3.cdd3f433-7db1-4b86-b06e-93720a587c1a.8bac10af-4c96-4a57-91ab-cea28ddfe50c