GCP Data Migration Engineer - PySpark Focus
A
Astra North Infoteck Inc.
📍 brampton, peel region, Canada
Job Description
Expand your expertise as a GCP Data Migration Engineer, specializing in PySpark and Salesforce migrations. Engage with cutting-edge cloud technologies to streamline data processes.
This position calls for at least 4-5 years of hands-on experience with Apache Spark and GCP Dataproc. You will engineer efficient ETL pipelines, utilizing Python for data transformations and ensuring compliance with Salesforce APIs. Strong SQL skills and a solid understanding of data schema relationships are vital.
Key Responsibilities:
• Execute ETL pipeline development within GCP ecosystem
• Program custom data transformations using PySpark and Python
• Design and optimize queries in BigQuery for data validation
• Oversee file management strategies leveraging GCS
• Maintain compliance with Salesforce data specifications
Requirements:
• 4-5 years of experience in data migration engineering
• Proficiency in Salesforce APIs and data models
• Capable of managing large datasets ...
This position calls for at least 4-5 years of hands-on experience with Apache Spark and GCP Dataproc. You will engineer efficient ETL pipelines, utilizing Python for data transformations and ensuring compliance with Salesforce APIs. Strong SQL skills and a solid understanding of data schema relationships are vital.
Key Responsibilities:
• Execute ETL pipeline development within GCP ecosystem
• Program custom data transformations using PySpark and Python
• Design and optimize queries in BigQuery for data validation
• Oversee file management strategies leveraging GCS
• Maintain compliance with Salesforce data specifications
Requirements:
• 4-5 years of experience in data migration engineering
• Proficiency in Salesforce APIs and data models
• Capable of managing large datasets ...