Job Description
About the JobWe are seeking a skilled Data Engineer to architect, build, and optimise scalable data platforms on cloud infrastructure. The role involves close collaboration with cross-functional teams to deliver robust, secure, and high-performance data solutions that support analytics and business operations.Core Responsibilities- Design, develop, and maintain scalable ETL/ELT pipelines, data lakes, and data warehouse solutions.- Build and optimize data ingestion frameworks for batch and real-time processing.- Develop and deploy containerised applications using Docker, Amazon ECR, and Amazon ECS.- Design and implement RESTful APIs for system integrations using modern frameworks (e.G., Fast API).- Implement Infrastructure as Code (Ia C) using Terraform and AWS Cloud Formation.- Establish and maintain CI/CD pipelines for automated build, test, and deployment workflows.- Ensure adherence to data security, governance, and compliance standards (e.G., encryption, access control).- Monitor, ...