Job Description
Join VLink as a Senior Data Engineering Specialist in Montreal, QC, focusing on Databricks and Spark technologies. This role emphasizes the migration of complex ETL processes to the cloud.
In this contract role, you will be responsible for hands-on design and implementation of regulatory reporting pipelines on an Azure environment. Your experience with Scala and Spark will be crucial in ensuring a seamless transition from legacy systems to a modern data architecture. You'll play a vital role in maintaining data quality and ensuring compliance with regulatory standards.
Key Responsibilities:
• Migrate regulatory reporting pipelines from legacy ETL systems
• Develop and test Spark applications using Scala
• Utilize SQL for detailed data requirement analyses
• Implement Azure services for streamlined operations
• Automate checks for data quality and reconciliation
Requirements:
• Advanced knowledge of Scala, Spark, and Databricks
• Strong SQL skills for data ...
In this contract role, you will be responsible for hands-on design and implementation of regulatory reporting pipelines on an Azure environment. Your experience with Scala and Spark will be crucial in ensuring a seamless transition from legacy systems to a modern data architecture. You'll play a vital role in maintaining data quality and ensuring compliance with regulatory standards.
Key Responsibilities:
• Migrate regulatory reporting pipelines from legacy ETL systems
• Develop and test Spark applications using Scala
• Utilize SQL for detailed data requirement analyses
• Implement Azure services for streamlined operations
• Automate checks for data quality and reconciliation
Requirements:
• Advanced knowledge of Scala, Spark, and Databricks
• Strong SQL skills for data ...