Data Bricks/Spark Engineer - Onsite in Montreal
V
VLink
📍 région de mistassini (chambord), qc, Canada
Job Description
Embark on a dynamic role as a Senior Data Bricks/Spark Engineer with VLink in Montreal, QC, driving cloud migration projects. This hands-on position focuses on utilizing Databricks and Scala effectively.
This 12-month contract involves migrating complex regulatory reporting pipelines to a state-of-the-art Azure platform. You'll be tasked with designing, implementing, testing, and ensuring data quality for production pipelines adhering to strict requirements. Contribute to modern data engineering practices and help shape the future of data solutions.
Key Responsibilities: • Design, implement, and execute production data pipelines • Optimize Spark applications written in Scala • Write and analyze complex SQL queries • Ensure compliance in data quality and reconciliation processes • Facilitate migration from legacy ETL to modern platforms
Requirements: • Expertise in Scala, Spark, and Databricks • Proficient in SQL and cloud data solutions • Hands-on experience ...
This 12-month contract involves migrating complex regulatory reporting pipelines to a state-of-the-art Azure platform. You'll be tasked with designing, implementing, testing, and ensuring data quality for production pipelines adhering to strict requirements. Contribute to modern data engineering practices and help shape the future of data solutions.
Key Responsibilities: • Design, implement, and execute production data pipelines • Optimize Spark applications written in Scala • Write and analyze complex SQL queries • Ensure compliance in data quality and reconciliation processes • Facilitate migration from legacy ETL to modern platforms
Requirements: • Expertise in Scala, Spark, and Databricks • Proficient in SQL and cloud data solutions • Hands-on experience ...