Job Description
Designs and develops data models and data pipelines to enable efficient data collection and processing from diverse data sources. Implements data governance policies and procedures for data handling to manage data consistency, integrity, accuracy, security, and reliability. Implements rigorous data validation and integrity checks to support data pipeline and model performance. Designs, develops, and optimizes automated and scalable data pipeline architectures to build data products, independently. Collaborates in an agile development environment to develop, maintain, and debug data solutions that are scalable, efficient, and reliable.
Key Responsibilities
Data Processing & Pipelining – Data Requirements, Collection, and Infrastructure:
Analyzes business requirements
Analyzes data sources to ensure successful data extraction and pipeline development.
Designs data models for optimal data processing and reporting perform...