Job Description
As an Azure Data Engineer, you will:
- Design, develop, and maintain scalable data pipelines and data integration solutions on the Microsoft Azure platform.
- Build and optimize ETL/ELT workflows using Azure Data Factory (ADF) and Azure Databricks (ADB).
- Develop robust data processing and transformation solutions using Python and Databricks.
- Design and implement batch and near real-time data ingestion pipelines from multiple enterprise data sources.
- Collaborate with data architects, business analysts, and development teams to translate business requirements into scalable data solutions.
- Develop reusable data engineering frameworks that improve reliability, performance, and maintainability.