Data Engineer

Job Description:

-Design, develop and deploy data tables, views and marts in data warehouses,operational data store, data lake and data virtualization.

-Perform data extraction, cleaning, transformation, and flow. Web scraping maybe also a part of the work scope in data extraction.

-Design, build, launch and maintain efficient and reliable large-scale batch andreal-time data pipelines with data processing frameworks.

-Integrate and collate data silos in a manner which is both scalable andcompliant.

-Collaborate with Project Manager, Data Architect, Business Analysts, FrontendDevelopers, Designers and Data Analyst to build scalable data driven products.

- Beresponsible for developing backend APIs & working on databases to supportthe applications.

- Workin an Agile Environment that practices Continuous Integration and Delivery.

- Workclosely with fellow developers through pair programming and code reviewprocess.