Job Description
- Design, develop, and maintain scalable data pipelines using Dataiku DSS .
Develop Python scripts for data ingestion, transformation, and automation.
Integrate external systems using REST APIs with Python (requests library).
Handle API authentication mechanisms such as OAuth , token management, pagination, retries, and rate limits.
Write and optimize complex SQL queries, including joins, window functions, CTEs, and performance tuning.
Process and manage semi-structured data formats such as JSON, XML, and Parquet .
Collaborate with data scientists, analysts, and business stakeholders to deliver reliable data solutions.
Maintain code using Git and follow collaborative development workflows.
Ensure data quality, performance optimization, and platform reliability.