ETL Developer

Roles and Responsibilities

• Develop and maintain efficient data processing scripts using Python and PySpark for large-scale data processing.
• Write clean, efficient, and maintainable Python code with good problem-solving skills.
• Develop scalable data transformation workflows using PySpark , with experience in AWS Glue considered an advantage.
• Use Git for source code management and version control.
• Use SSH to securely access and manage Linux servers.
• Design, develop, and maintain ETL/ELT pipelines for processing structured and semi-structured data.
• Support deployment, monitoring, and maintenance of data pipelines in cloud environments .
• Optimize ETL jobs for performance, scalability, and cost efficiency.
• Perform data extraction, cleansing, transformation, and validation to support reporting, analytics, and business intelligence r...