Data Engineer (Senior)

SUMMARY:
ESSENTIAL SKILLS:

• Strong experience with Python (Python 3.x) and PySpark for developing data processing jobs.
• At least 3 years’ experience with AWS services commonly used by data engineers, such as Athena, Glue, Lambda, S3 and ECS.
• Hands-on experience with NoSQL databases such as DynamoDB and relational databases (Oracle/PostgreSQL) including strong Oracle SQL skills.
• Experience with Oracle Cloud Infrastructure (OCI) services and tooling for databases, storage, and data processing.
• Expertise in data formats and schema design, including Parquet, AVRO, JSON, XML and CSV, and technical data modelling (“not drag and drop”).
• ETL and data pipeline development experience, including building pipelines with AWS Glue or similar platforms.
• Experience with containerization and orchestration technologies such as Docker (Kubernetes/OpenShift advantageous).
• Proficiency wi...