Job Description
Job Description
Insight Global is seeking a Lead Data Engineer to join a large retail client based in Vancouver, BC. The data engineering team builds and maintains the data infrastructure that powers analytics, reporting, and data-driven decision making across the company’s digital platforms, retail operations, and business units. We work with cross-functional agile squads to develop reliable data pipelines, improve data quality, build self-serve analytics tools for our business stakeholders, and ensure timely access to accurate data for our analysts and data scientists. This Lead Engineer will be responsible for supporting several upcoming initiatives, including modernizing the organization’s data platform through the migration of data pipelines from Azure Data Factory to Databricks and the transition of legacy Hive tables to Unity Catalog. The ideal candidate will bring strong Databricks experience, including a solid understanding of Medallion Architecture and best practices for d...
Insight Global is seeking a Lead Data Engineer to join a large retail client based in Vancouver, BC. The data engineering team builds and maintains the data infrastructure that powers analytics, reporting, and data-driven decision making across the company’s digital platforms, retail operations, and business units. We work with cross-functional agile squads to develop reliable data pipelines, improve data quality, build self-serve analytics tools for our business stakeholders, and ensure timely access to accurate data for our analysts and data scientists. This Lead Engineer will be responsible for supporting several upcoming initiatives, including modernizing the organization’s data platform through the migration of data pipelines from Azure Data Factory to Databricks and the transition of legacy Hive tables to Unity Catalog. The ideal candidate will bring strong Databricks experience, including a solid understanding of Medallion Architecture and best practices for d...