Microsoft Azure Data Engineer

Overview

Introduction

In today’s data-driven world, organizations are rapidly moving to the cloud to modernize their data platforms. Microsoft Azure has emerged as a leading platform offering scalable and versatile tools for data engineering. This 4-day Microsoft Azure Data Engineer course is designed to equip professionals with the skills needed to implement, manage, and optimize data solutions on Azure. Participants will explore key Azure services including Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure Stream Analytics, and Azure Databricks. The training focuses on building and managing data pipelines, transforming data using serverless and Apache Spark SQL pools, integrating real-time streaming data, and governing enterprise data with Microsoft Purview. With a strong emphasis on hands-on labs and real-world scenarios, this course prepares learners to build secure, scalable, and high-performing data engineering solutions that support advanced analytics and business intelligence needs. This course is aligned with the DP-203 certification requirements.

Who Should Attend

  • Data engineers and data professionals
  • Business Intelligence developers and data architects
  • Data analysts and data scientists
  • Professionals preparing for Microsoft Certified: Azure Data Engineer Associate (DP-203).
  • IT professionals with a foundational knowledge of cloud and data concepts looking to upskill.

Learning Outcomes

  • Understand core concepts of data engineering on Microsoft Azure.
  • Design and implement data storage solutions using Azure Data Lake and Synapse Analytics.
  • Develop serverless and Apache Spark-based data processing pipelines.
  • Build and manage relational data warehouses and lake databases.
  • Create data pipelines using Azure Synapse and Spark Notebooks.
  • Integrate streaming data using Azure Stream Analytics and visualize it in Power BI.
  • Govern data using Microsoft Purview and manage metadata across services.
  • Utilize Azure Databricks for scalable data engineering and machine learning workloads.

Main Modules


Modules

Day 1: Foundations of Data Engineering on Azure

  • Overview of Data Engineering Concepts and Azure Services
  • Introduction to Azure Data Lake Storage Gen2
  • Introduction to Azure Synapse Analytics
  • Understanding Data Storage Solutions in Azure
  • Hands-on: Navigating Azure Data Lake and Synapse Studio
  • Introduction to Serverless SQL Pools in Synapse
  • Querying files in a Data Lake using Serverless SQL
  • Lab Exercise & Recap Discussion

Perform data engineering with Azure Synapse Apache Spark Pools

  • Analyze data with Apache Spark in Azure Synapse Analytics
  • Transform data with Apache Spark in Azure Synapse Analytics
  • Use Delta Lake in Azure Synapse Analytics

Work with data warehouses using Azure Synapse Analytics

  • Analyze data in a relational data warehouse
  • Load data into a relational data warehouse

Transfer and transform data with Azure Synapse Analytics Pipelines

  • Build a data pipeline in Azure Synapse Analytics
  • Use Spark Notebooks in an Azure Synapse Pipeline

Work with hybrid transactional and analytical processing (HTAP) Solutions using Azure Synapse Analytics

  • Plan hybrid transactional and analytical processing
  • Implement Azure Synapse Link with Azure Cosmos DB
  • Implement Azure Synapse Link for SQL

Implement a data streaming solution with Azure Stream Analytics

  • Get started with Azure Stream Analytics
  • Ingest streaming data using Azure Stream Analytics and Azure Synapse Analytics
  • Visualize real-time data with Azure Stream Analytics and Power BI

Govern data across an enterprise

  • Introduction to Microsoft Purview
  • Integrate Microsoft Purview and Azure Synapse Analytics

Data engineering with Azure Databricks

  • Explore Azure Databricks
  • Use Apache Spark in Azure Databricks
  • Run Azure Databricks notebooks in Azure Data Factory

Mode Of Learning

online, classroom

Course Code

TIC002

Price

Duration

5 Days

Category

IT & Cybersecurity

Language

English

Certification

No