Senior Data Engineering Role: Databricks & Spark
V
VLink
📍 rimouski, qc, Canada
Job Description
Advance your career with VLink as a Senior Data Engineer specializing in Databricks and Spark in Montreal, QC. Engage in a critical role to migrate legacy data pipelines onsite.
This hands-on 12-month contract position focuses on designing, implementing, and reconciling production pipelines that meet regulatory reporting standards. Your proficiency in Spark applications, SQL, and data engineering best practices will be essential for executing complex migrations.
Key Responsibilities:
• Design and implement data pipelines for regulatory needs
• Conduct large-scale migrations from legacy ETL systems
• Analyze and write complex SQL requirements
• Use Databricks features for enhanced performance
• Ensure high data quality and reconciliation
Requirements:
• High proficiency in Scala and Spark in production
• Familiarity with Databricks and Azure ecosystems
• Experience with CI/CD pipelines and Airflow
• Knowledge of testing frameworks like ScalaTest
• ...
This hands-on 12-month contract position focuses on designing, implementing, and reconciling production pipelines that meet regulatory reporting standards. Your proficiency in Spark applications, SQL, and data engineering best practices will be essential for executing complex migrations.
Key Responsibilities:
• Design and implement data pipelines for regulatory needs
• Conduct large-scale migrations from legacy ETL systems
• Analyze and write complex SQL requirements
• Use Databricks features for enhanced performance
• Ensure high data quality and reconciliation
Requirements:
• High proficiency in Scala and Spark in production
• Familiarity with Databricks and Azure ecosystems
• Experience with CI/CD pipelines and Airflow
• Knowledge of testing frameworks like ScalaTest
• ...