Azure Data Engineer for Data Optimization
P
Pacer Group
📍 toronto, on, Canada
Job Description
Seize the opportunity as an Azure Data Engineer focused on optimizing data processes using Azure technologies. Your skills in Data Factory and troubleshooting will be central to this role.
This role is ideal for those with a solid background in Azure services, data ingestion patterns, and data warehousing. Your expertise in troubleshooting cluster issues and pipeline failures will ensure high-performance data operations. Experience with CI/CD pipelines and Azure DevOps will enhance project development and implementation.
Key Responsibilities:
• Develop and optimize ETL/ELT data processes
• Address data pipeline failures and enhance performance
• Monitor operations using Azure Monitor and Databricks logs
• Manage version control and collaboration with Git
• Resolve issues within data clusters and workflows
Requirements:
• Strong expertise in Azure Data Factory and Databricks
• Proficient in Azure SQL and Spark SQL
• Experience with data warehousing and i...
This role is ideal for those with a solid background in Azure services, data ingestion patterns, and data warehousing. Your expertise in troubleshooting cluster issues and pipeline failures will ensure high-performance data operations. Experience with CI/CD pipelines and Azure DevOps will enhance project development and implementation.
Key Responsibilities:
• Develop and optimize ETL/ELT data processes
• Address data pipeline failures and enhance performance
• Monitor operations using Azure Monitor and Databricks logs
• Manage version control and collaboration with Git
• Resolve issues within data clusters and workflows
Requirements:
• Strong expertise in Azure Data Factory and Databricks
• Proficient in Azure SQL and Spark SQL
• Experience with data warehousing and i...