Senior Scala Spark Engineer in Montreal
V
VLink
📍 saint prosper de champlain, qc, Canada
Job Description
Drive critical data migration as a Senior Data Bricks/Scala/Spark Engineering Specialist in Montreal, QC. Transform regulatory reporting pipelines to a state-of-the-art Databricks and Snowflake setup.
This hands-on contract role focuses on migrating on-prem regulatory reporting systems to Azure's Databricks and Snowflake. You will design, implement, and test production pipelines to meet strict compliance requirements. Candidates should be adept in Scala, Spark, and have a solid understanding of SQL and data orchestration tools.
Key Responsibilities: • Design and implement regulatory reporting pipelines in Azure • Migrate legacy ETL pipelines to Databricks and Snowflake • Write and analyze complex SQL scripts for data validation • Utilize Airflow for orchestrating data workflows • Conduct testing and ensure data quality with TDD practices
Requirements: • Proven Scala and Spark production experience • Expertise in Databricks and Snowflake architecture • Familia...
This hands-on contract role focuses on migrating on-prem regulatory reporting systems to Azure's Databricks and Snowflake. You will design, implement, and test production pipelines to meet strict compliance requirements. Candidates should be adept in Scala, Spark, and have a solid understanding of SQL and data orchestration tools.
Key Responsibilities: • Design and implement regulatory reporting pipelines in Azure • Migrate legacy ETL pipelines to Databricks and Snowflake • Write and analyze complex SQL scripts for data validation • Utilize Airflow for orchestrating data workflows • Conduct testing and ensure data quality with TDD practices
Requirements: • Proven Scala and Spark production experience • Expertise in Databricks and Snowflake architecture • Familia...