about the company
My client is one of the most established and reputable MNC within the Insurance industry. They have a history of more than 60 years and has a strong presence in APAC with Singapore as the headquarter. They are currently expanding and you would now have the opportunity to join this exciting company as a Lead Data Engineer.
...
about the job
- Best Practices for Data Architecture and Design Patterns for Data Engineering Use-
- Cases.
- Real-time data feeds from database sources like MySQL, Oracle, and MS SQLServer
- using the “Change Data Capture Engine”
- Sub-Second Real-Time Data Pipelines using AWS Kinesis, Glue, Spark, Kinesis,
- Lambda .
- Batch Pipeline Orchestration using on Apache Airflow and Jenkins.
- Auto Scalable platform using Kubernetes on EKS.
- Org Wide Master Data Management, Data Catalog Engine, and Data Quality Engine.
skills and experience required
- At least 6-7 years of data engineering experience
- Have strong fundamentals in Computer Science concepts like Cloud Computing
- Architecture, Distributed Computing, High-Velocity Data Processing, Lambda
- Architecture
- Strong Data modeling and managing Distributed Computing Platforms for Data
- Processing.
- Advance knowledge of SQL and writing resource-efficient queries.
- Have at least 2+ years of professional programming experience in Python.
- Have at least 2+ years of experience in running a data processing pipelines on either
- of these: Google BigQuery, Redshift, Hadoop, Presto, Spark, or KSQL.
To apply online, please click on the appropriate link. Alternatively please contact Winson Tan at 6510 3638 to discuss more on the opportunity. EA: 94C3609 / R1113471
Applicants must be fully vaccinated or have a valid exemption in accordance with MOM’s regulations to allow them to enter the workplace. Applicants may be required to share verifiable COVID-19 vaccination documents or proof of a valid exemption at the point of offer. Randstad Pte. Limited and/or the Client reserves the right to withdraw an offer if the applicant fails to provide verifiable COVID-19 vaccination and/or proof of exemption documents.