Job Description
Responsibilities
- Develop and maintain data ingestion, transformation, and publishing pipelines (ETL/ELT).
- Integrate data from different systems, formats, and domains.
- Implement versioning, lineage, and data validation mechanisms.
- Ensure performance, monitoring, reliability, and cost control of data flows.
- Automate processes and support the continuous operation of data environments.
- Support data science and AI teams by providing analysis-ready data.
- Document pipelines and support knowledge transfer.
Requirements
- Bachelor's degree in Computer Engineering, Computer Science, Information Technology Management, or Information Systems.
- 4 to 6 years of experience as a data engineer or in a similar role.
- Programming languages: Python, SQL, and Go.
- Experience with pipeline orchestration and automation.
- Integration with cloud environments (AWS, Azure, or GCP). ...