In this Part 2 video of CI/CD in Azure Databricks, I discussed the different environment configurations required to create the CI/CD pipelines. This demo video shows things like integrating Azure DevOps with Azure Databricks workspace, branch protection, and merging techniques.

The next parts will be uploaded soon, stay tuned!

Part 3. Creating a CI pipeline
Part 4. Creating a CD pipeline and testing

Here's what you'll see in this video:

0:00:00 – Introduction
0:02:10 – Creating an Azure DevOps Git repository
0:05:51 – Git integration with Azure Databricks
0:11:23 – Branch protection
0:20:13 – Merging changes with main
0:28:00 – Outro

– – – Book a private one-on-one meeting with me (1 hour) – – –

https://www.buymeacoffee.com/mrktalkstech/e/166354

– – – /“Express your encouragement by brewing me a cup of support/” – – –

https://www.buymeacoffee.com/mrktalkstech

– – – Other useful playlists: – – –

Azure Data Factory playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXwTClTt3_28CMz2dZoaFhKD

Playlist on general Azure topics: https://www.youtube.com/playlist?listPLrG_BXEk3kXxv0IEASoJRTHuRq_DUqrjR

Microsoft Fabric playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXybedCIBBI4lmaIbtbn7MdM

Azure Databricks playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXznRvTJXwmazGCvTSxdCMsN

Azure End-to-End Project Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXx6KE4nBmhf6QwSHMbznP2W

Databricks CICD playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXzMLDAgRbDsbIKvhoWsu-Gq

End-to-End Azure Data Engineering Project: https://youtu.be/iQ41WqhHglk

– – – Let’s stay in touch: – – –

Email: [email protected]
Instagram: mrk_talkstech

– – – Tools and equipment (equipment I used): – – –

Disclaimer: The links included in this description may be affiliate links. If you purchase a product or service through the links I provide, I may receive a small commission. There is no additional cost to you! Thank you for your support so I can continue to bring you free content each week!

DJI microphone: https://amzn.to/3sNpDv8
Dell XPS 13 Plus 13.4/" 3.5K: https://amzn.to/45KqH1c
Rode VideoMicro Vlogger Kit: https://amzn.to/3sVFW8Y
DJI Osmos Action 3: https://amzn.to/44KYV3x
DJI Mini 3 PRO: https://amzn.to/3PwRwAr

– – – About me: – – –

Mr. K is a passionate teacher who created this channel with only one goal: /“To help people learn about modern data platform solutions using cloud technologies/”

I will create a playlist covering the following topics (with DEMO)

1. Azure Tutorials for Beginners
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)

After creating some basic foundation videos, I will create some videos with real-time scenarios/use cases specific to the three common data fields.

1. Data Engineer
2. Data Analyst
3. Data Scientist

I can't wait to help people with my videos.

– – – Support me: – – –

Please subscribe: https://www.youtube.com/@mr.ktalkstech

#AzureDatabricks #ApacheSpark #Sparkcompute #Cluster #Notebooks #MagicCommands #MachineLearning #ETL

Please take the opportunity to connect with your friends and family and share this video with them if you find it useful.