Big Data Analytics Implementation for SharePoint and OneDrive - 8 Week Implementation

Before enabling Microsoft 365 / Power BI co-pilot or during a security audit, it's important to thoroughly examine all permission settings and folders/files sharing in SharePoint Online and OneDrive to ensure no oversharing and improper permission assignment. This process might encounter performance challenges, such as obtaining comprehensive and timely insights using PowerShell or third-party tools, especially when dealing with very large datasets that could lead to timeouts due to throttling.

Enabling Big Data Analytics on SharePoint and OneDrive empowers your organization to efficiently extract, transform and load very-large datasets from Microsoft Cloud into Azure Data Lake, focusing particularly on SharePoint and OneDrive data. These improved functionalities enhance your Data Analysis team's ability to create custom Power BI reports and dashboards, allowing for comprehensive management and analysis of cloud content in areas such as security, sharing and capacity.

Implementation Activities to be Completed:

1. Plan and Design

• Understand business needs for cloud content management and analysis in areas such as security, sharing and capacity
• Provide Technical Design Specification (TDS) to summarize and finalize the requirements of Azure Synapse pipeline and related Power BI dashboard

2. Develop and Test

• Develop and test Azure Synapse pipeline(s) to extract, transform and load (ETL) the Cloud content from Microsoft Graph Data Connect (MGDC) datasets to Azure Data Lake
• Merge the extracted delta dataset with full dataset
• Build Power BI dashboard(s) to manage and analyze cloud content in areas such as security, sharing and capacity
• Fine tune Power BI dashboard(s) based on the comments from the selected key test users from different business units or departments

3. Execution and Support

• Configure schedule and frequency of the developed Azure Synapse pipeline, and execute
• Provide 2-weeks nursing support after enablement
• Provide tailor-made admin users training session for administering the developed Azure Synapse pipeline

Output

• Technical Design Specification for summarizing and finalizing all the technical requirements
• Azure Synapse pipeline(s) for the ETL jobs of Cloud content from MGDC datasets to Azure Data Lake and merging jobs with delta dataset
• Power BI dashboard(s) for security, sharing, and capacity insights
• Tailor-made admin users training session for administering the developed Azure Synapse pipeline