Benny Austin, Partner Solution Architect at Microsoft, has released some resources to a GitHub repository, alongside some explanatory wiki text explaining the solution.
From the repo: "This accelerator will help you build a modern data platform end-to-end with Microsoft Fabric." The architecture can be seen below.
๐ Links:
Key Features:
- Medallion architecture 1
- Metadata-driven orchestration using ELT Framework 2
- Resusable Data Factory Pipelines that can be readily deployed with configuration changes 3
- Reusable Spark notebooks for common transformations 4
- Automated monitoring and optimization of Lakehouses 5
- Real-time Insights into batch jobs 6
- Infrastructure as Code (IaC) Bicep for provisioning cloud resources 7
- Comprehensive documentation to assist your implementation.