Microsoft Fabric: Do k-Means clustering in spark; analyze in Power BI | Integrated Machine Learning

In this video, we use Integrated Spark in Microsoft Fabric for Machine Learning. k-Means clustering in Python is used to do clustering and Power BI is used to analyze the clusters.

Microsoft has Microsoft Fabric, the next-generation Analytic Platform. Check out how to enable it on Power BI Service. How to start a Fabric (Preview) trial
The Microsoft Fabric Platform provides customers with a SaaS-ified, open, lake-centric(One Lake), full-featured data, analytics, and AI platform that meets all their data estate needs. Power BI, Synapse Data Warehouse, Data Factory, Spark, and Notebook all under one platform

00:00 Problem Statement
02:30 Work on Notebook, Load Data
05:30 Use k-Means clustering
9:30 Save files in Lakehouse
11:00 Save table in Lakehouse Using Spark DataFrame
14:30 Test using SQL
15:20 Analyze in Power BI

Microsoft Documentation link
https://learn.microsoft.com/en-us/fabric/data-engineering/lakehouse-notebook-load-data?toc=%2Ffabric%2Fdata-science%2Ftoc.json&bc=%2Ffabric%2Fdata-science%2Fbreadcrumb%2Ftoc.json
https://learn.microsoft.com/en-us/fabric/data-science/read-write-pandas

GIT File link –
https://github.com/amitchandakpbi/powerbi/raw/main/csv/retailData_fabric.csv
https://github.com/amitchandakpbi/powerbi/raw/main/Sales%20Data%20for%20Fabric.xlsx
All files: https://github.com/amitchandakpbi/powerbi

Power BI – Azure Free Tier, Create Azure Data Lake Gen 2 and connect that in Power BI: https://www.youtube.com/watch?v=x_hxpTgMAC0

Get Azure SQL DB and Configure it on Power BI: https://youtu.be/ZPfszCv3K3Y

Official Document: https://learn.microsoft.com/en-us/fabric/get-started/fabric-trial
Video from GuyinaCube: https://www.youtube.com/watch?v=5jlP0wdEsls
Buy a Microsoft Fabric subscription: https://learn.microsoft.com/en-us/fabric/enterprise/buy-subscription
SKU: https://learn.microsoft.com/en-us/fabric/enterprise/licenses#capacity-and-skus
Licenses: https://learn.microsoft.com/en-us/fabric/enterprise/licenses
Enable Fabric: https://learn.microsoft.com/en-us/fabric/admin/fabric-switch

🔵 What is Microsoft Fabric
Microsoft Fabric is an all-in-one analytics solution for enterprises that covers everything from data movement to data science, Real-Time Analytics, and business intelligence. It offers a comprehensive suite of services, including data lake, data engineering, and data integration, all in one place.

With Fabric, you don’t need to piece together different services from multiple vendors. Instead, you can enjoy a highly integrated, end-to-end, and easy-to-use product that is designed to simplify your analytics needs.

How to enable Fabric, find details – https://learn.microsoft.com/en-us/fabric/admin/fabric-switch
Microsoft Fabric licenses details -https://learn.microsoft.com/en-us/fabric/enterprise/licenses

Don’t forget to like, comment, and subscribe for more great content!
▶️Please Subscribe: https://www.youtube.com/@AmitChandak
▶️Data:
• Covid 19: https://covid19.who.int/WHO-COVID-19-…
• Get The data and Pbix files on Github: https://github.com/amitchandakpbi/powerbi
• DropBox files: https://www.dropbox.com/sh/90ycq7hpmngabe9/AABR_l_4sy3SSALA_U95gIkWa

———
▶️Follow me on:
• Medium: https://amitchandak.medium.com
• Twitter: https://twitter.com/amitchandak78
• LinkedIn: https://www.linkedin.com/in/amitchandak78/
———
▶️My Other Videos:
• Mastering Power BI: https://www.youtube.com/watch?v=wvsAzTqSDVg&list=PLPaNVDMhUXGaaqV92SBD5X2hk3TMNlHhb
• Expertise Power BI: https://www.youtube.com/watch?v=59PUFuuCrbY&list=PLPaNVDMhUXGYo50Ajmr4SgSV9HIQLxc8L