application developer etl/hadoop in Singapore

about the company
Insurance firm providing general insurance products

about the job

• This role will manage, support the design, develop and maintain the Data Lake / DWH Solutions
• Responsible for data analysis, data profiling, physical database design, CDC and ETL design and development
• Performance tuning, and optimization of the data lake, data warehouse, ODS, SCV, reference and master data, and data migration
• Assist in creating metadata documentation such as system/data flow diagram, and other metadata (e.g. data mapping, data transformation, data dictionary, and etc.)
• Prepare test data. Assist in creating and executing the test plan, test cases and test scripts.
• Assist in creating standard process in terms of ETL process, data management, naming convention, and terminologies that will be used in Database, CDC, and ETL/ELT.
• Design and develop the best approach to manage data logging (log, auditing, and error handling), and auto capturing missing records.

skills and experience required

• Hands-on experience in Hadoop Ecosystems and building data lake/ or big data including all the tools for CDC and ETL
• Knowledge of AWS architecture and infrastructure
• 2- 3 years for the design and ETL processes – including fine tuning, and optimization of DB & ETL jobs
• Knowledge of handling data (structured, semi-structured, and unstructured)
• Experience in best practice of designing and developing of database, PL/T-SQL, ETL process, logging, auditing, and error handling (preferred)
• Experience in various techniques and strategies in creating test plan, test cases, test scripts, and test scripts for data integration.

To apply online please use the 'apply' function, alternatively you may contact <Josy Thomas> at <6510 6530>.
(EA: 94C3609/ <ID R1325727> )