Senior Data Engineering Specialist in Montreal
V
VLink
📍 chambord, qc, Canada
Job Description
Take on a pivotal role as a Senior Data Engineering Specialist, focusing on Databricks, Scala, and Spark in Montreal, QC. Apply your skills to migrate complex reporting pipelines effectively.
This contract position offers hands-on work in migrating regulatory reporting pipelines to a modern Azure-based Databricks and Snowflake platform. You will design, implement, test, and reconcile production pipelines while ensuring strict compliance with parity requirements. The focus is on leveraging modern data engineering practices to ensure quality and reliability.
Key Responsibilities:
• Design and implement complex data pipelines in Databricks
• Write optimized Spark applications in Scala
• Analyze and execute complex SQL queries
• Manage migration from legacy ETL processes to cloud platforms
• Build automated data quality and reconciliation tools
Requirements:
• Proven experience with Scala, Spark, and Databricks
• Fluency in SQL for data extraction and analysis...
This contract position offers hands-on work in migrating regulatory reporting pipelines to a modern Azure-based Databricks and Snowflake platform. You will design, implement, test, and reconcile production pipelines while ensuring strict compliance with parity requirements. The focus is on leveraging modern data engineering practices to ensure quality and reliability.
Key Responsibilities:
• Design and implement complex data pipelines in Databricks
• Write optimized Spark applications in Scala
• Analyze and execute complex SQL queries
• Manage migration from legacy ETL processes to cloud platforms
• Build automated data quality and reconciliation tools
Requirements:
• Proven experience with Scala, Spark, and Databricks
• Fluency in SQL for data extraction and analysis...