data engineer | etl/elt | python | aws.

about the company
We are working with a global technology company established in 2019, providing sophisticated and reliable IT services, with a strong focus on network security and privacy protection, for some of the world's fastest-growing mobile services.

They have tens of millions of users endorsing their capabilities. Headquartered in Singapore, the company operates offices worldwide, including in North America, Taiwan, and other countries in Asia!

about the job

You will design, build, and optimize scalable data infrastructure, ensuring data quality and governance across our platforms.

• Design, build, and maintain ETL/ELT data pipelines using AWS services (Glue, Step Functions, Lambda, Redshift) and efficient data ingestion frameworks from diverse sources. Implement performance optimization (incremental load, CDC, partitioning) and CI/CD automation for monitoring and version control.
• Design and implement dimensional data models (star/snowflake schemas). Manage data warehouses/lakes (Redshift, S3, Lake Formation) with partitioning and access control. Collaborate with analysts on data mart design and manage schema evolution.
• Implement validation frameworks to ensure data accuracy and consistency. Develop automated quality reports/alerts (CloudWatch, SNS). Establish policies for metadata management, lineage tracking, and access control , ensuring compliance with regulations (GDPR, PDPA).
• Continuously improve ETL efficiency (parallelization, query optimization). Optimize cloud storage/compute costs. Design for high availability and disaster recovery.

...