Principal Data Engineer – Databricks
A
Astra North Infoteck Inc.
📍 Toronto, Ontario, Canada
Job Description
Job Description
Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/Azure
Job Description
Location: Toronto
Work Model: Onsite (4 days/week)
Key Requirements
• 12–18 years of overall Data Engineering experience.
• 8+ years of experience with Enterprise Data Warehouse and Data Lake platforms.
• 5+ years of hands-on experience with Databricks and Apache Spark at scale.
• Strong experience modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse.
• Experience redesigning ingestion, transformation, and consumption patterns from HDFS-based architecture to cloud object storage and Delta Lake.
• Experience refactoring legacy Hive/Impala logic int...