Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More

Memberships

Fabric Dojo ็ป‡็‰ฉ

364 members โ€ข $30/month

Learn Microsoft Fabric

14.3k members โ€ข Free

5 contributions to Learn Microsoft Fabric
โ“ How are you using Variable Libraries? (If at all!)
Hey community! Are you using the Variable Library in Fabric?! I'm doing some research for a future YouTube video, and it would be great to open up a bit of a discussion around how you're using them so far, considering they are now Generally Available! What use cases are you using them for? Any tips to share about how you set them up? Or perhaps you're using the REST API endpoints for variable libraries for more advanced use cases? Any experience, big or small, would be useful to know about - so please share below! ๐Ÿ‘‡๐Ÿ‘‡๐Ÿ‘‡
Poll
68 members have voted
1 like โ€ข Nov 10
Have used it before to ensure a dynamic driven pipeline used to refresh semantic model schedules between different workspaces
1 like โ€ข Nov 10
@Will Needham No just the workspace ID's and other dynamic content info for pipeline activities in the library, all other details for semantic models i.e. name, etc in a config table
Data Cleansing
Any preferred approaches/tips to follow when performing cleansing on data? As a first step data profiling makes sense where one can make use of public libraries for profiling e.g. ydata and great expectations to assist, after which you will get an idea how data is stored and used. Apart from applying the basic cleansing operations for e.g. on text fields to remove special and non-ascii characters and also remove more than 2 consecutive spaces, what else would be suggested? I guess this depends on the data owners which could vary based on requirements. More granular cleansing operations would require mappings to indicate a from and to value which could be put into a config table and then read via notebook processing when moving data between bronze and silver. Are the any other comments/steps/tips to consider as part of a best-practice approach?
Master Data
Any preferred approaches/tips to follow when performing analysis & design for master data management? I would think that the identification of core business entities could be a first step? Then to also indicate non-transactional entities; entities shared across multiple systems; entities that are slow changing and hold the single source of truth. Next steps could involve improving data quality to get data curated and cleaned properly. Lastly, when it comes to endorsement I would think this could be from 2 viewpoints, from a consulting/suggested perspective and implementing the means to action from a customer/data owner view for e.g. identifying data owners, adding them to security groups and applying the adequate permissions in fabric to allow them to tag/endorse data with the master data badge/classification. Are the any other comments/steps/tips to consider as part of a best-practice approach?
0 likes โ€ข Sep 16
Thanks Sambhav, much appreciated!
Data Quality discussion
Hi all! I would love to get your views and experiences with data quality and data validation in data analytics/ viz/ engineering. It would be great to hear your experiences on any of the following: - Is this an area you've worked in before? - If so, what were you doing and - how did you approach it? - Any particular tools or frameworks you used? - What were the outcomes for you and your company/ client? The reason I'm asking is that for me it's probably the most important part of any data strategy, and one that is often neglected. Fabric makes it simpler to implement data quality/ validation rules in nearly every part of the data analytics workflow/ system. If there's any interest, I'll look to create a series of videos on how to think about data quality and validation within Fabric, and how to actually implement measures that grow trust in your analytics systems, visualizations and insights.
Data Quality discussion
0 likes โ€ข Sep 11
I have attempted with libraries ydata-profiling and openpyxl to get deeper profiling done, actioning tables with 22m+ rows taking a subset of the recent 18 months data and a sample of max 200k. When excluding visuals and opting to output results to a matrix, the speed of processing was very good. Using a matrix to list output, you are able to offset table fields against metrics to get a good view of data quality. Metrics I pulled included column, type, missing%, unique%, maxlength, min, max, mean, std, textanomalies, sample and cleaning suggestion (if logic based on metric results). The metric results can then be used as input to the cleaning procedures performed on the bronze layer to produce cleaned data for the silver layer.
๐Ÿ‘‹ New joiner? Welcome! Start here ๐Ÿ‘‡
Welcome to all new members, here's some links and information to help you get started! ๐—ค๐˜‚๐—ถ๐—ฐ๐—ธ ๐—Ÿ๐—ถ๐—ป๐—ธ๐˜€ ๐˜๐—ผ ๐—ด๐—ฒ๐˜ ๐˜€๐˜๐—ฎ๐—ฟ๐˜๐—ฒ๐—ฑ - For an introduction to this community โ†’ Explore the Welcome Pack - New-ish to Fabric? โ†’ Check out our Fabric Foundation module - Studying for the DP-600? โ†’ Check out the DP-600 Module and the DP-600 category - Studying for the DP-700? โ†’ Check out the DP-700 Module and the DP-700 category - Want to get hands-on? โ†’ Check out Fabric Dojo ๐—›๐—ผ๐˜„ ๐˜๐—ผ ๐—ฒ๐—ป๐—ด๐—ฎ๐—ด๐—ฒ ๐˜„๐—ถ๐˜๐—ต ๐˜๐—ต๐—ฒ ๐—ฐ๐—ผ๐—บ๐—บ๐˜‚๐—ป๐—ถ๐˜๐˜†? - Share your knowledge and experience! Even if you're relatively new to Fabric, or the community, your opinion and experiences are valued here! A great way to earn your first point(s) is to introduce yourself in the thread below ๐Ÿ‘‡๐Ÿ˜€ Thank you for engaging and joining us on this exciting learning journey! ๐Ÿ™ Will
2 likes โ€ข Jun 5
Hi Everyone, I am Zach from Cape Town, South Africa...a new joiner working as a Data Engineer starting out with Fabric. Looking to dive into the basics and get certified for DP-600 and DP-700 asap. Looking forward to be part of this community!
1-5 of 5
Zach Bester
2
12points to level up
@zach-bester-3885
Software Engineer (developer) entering the Fabric space

Active 27d ago
Joined Apr 8, 2025
Powered by