In this Part 1 of CI/CD in Azure Databricks video, I explained what CI/CD is, how we will use it to deploy Azure Databricks notebooks from development to production, and what merge techniques we will use to build the CI/CD pipelines.

The next parts will be uploaded soon, stay tuned!

Part 2: Setting up the repos
Part 3. Creating a CI pipeline
Part 4. Creating a CD pipeline and testing

Chapter

Time stamp:

0:00:00 – Introduction
0:01:13 – What is CI/CD?
0:04:51 – Merge/Branch techniques used in CI/CD
0:09:55 – Outro

– – – Book a private one-on-one meeting with me (1 hour) – – –

https://www.buymeacoffee.com/mrktalkstech/e/166354

– – – /“Express your encouragement by brewing me a cup of support/” – – –

https://www.buymeacoffee.com/mrktalkstech

– – – Other useful playlists: – – –

1. Microsoft Fabric Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXybedCIBBI4lmaIbtbn7MdM
2. Playlist on general Azure topics: https://www.youtube.com/playlist?listPLrG_BXEk3kXxv0IEASoJRTHuRq_DUqrjR
3. Azure Data Factory playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXwTClTt3_28CMz2dZoaFhKD
4. Databricks CICD playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXzMLDAgRbDsbIKvhoWsu-Gq
5. Azure Databricks Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXznRvTJXwmazGCvTSxdCMsN
6. Azure End-to-End Project Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXx6KE4nBmhf6QwSHMbznP2W
7. End-to-End Azure Data Engineering Project: https://youtu.be/iQ41WqhHglk

– – – Let’s stay in touch: – – –

Email: [email protected]
Instagram: mrk_talkstech

– – – Tools and equipment (equipment I used): – – –

Disclaimer: The links included in this description may be affiliate links. If you purchase a product or service through the links I provide, I may receive a small commission. There is no additional cost to you! Thank you for your support so I can continue to bring you free content each week!

DJI microphone: https://amzn.to/3sNpDv8
Dell XPS 13 Plus 13.4/" 3.5K: https://amzn.to/45KqH1c
Rode VideoMicro Vlogger Kit: https://amzn.to/3sVFW8Y
DJI Osmos Action 3: https://amzn.to/44KYV3x
DJI Mini 3 PRO: https://amzn.to/3PwRwAr

– – – About me: – – –

Mr. K is a passionate teacher who created this channel with only one goal: /“To help people learn about modern data platform solutions using cloud technologies/”

I will create a playlist covering the following topics (with DEMO)

1. Azure Tutorials for Beginners
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)

After creating some basic foundation videos, I will create some videos with real-time scenarios/use cases specific to the three common data fields.

1. Data Engineer
2. Data Analyst
3. Data Scientist

I can't wait to help people with my videos.

– – – Support me: – – –

Please subscribe: https://www.youtube.com/@mr.ktalkstech

#AzureDatabricks #ApacheSpark #Sparkcompute #Cluster #Notebooks #MagicCommands #MachineLearning #ETL

Please take the opportunity to connect with your friends and family and share this video with them if you find it useful.