Senior Data Engineer

Responsibilities:

• Design, build and maintain data pipelines and ETL processes to support data integration and analysis from various sources, such as databases, APIs, and data warehouses, to data storage and processing systems
• Ability to design solutions independently based on high-level architecture.
• Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Assess quality of data, cleanse data issues for validity and accuracy.
• Maintain and optimize data storage and processing systems, ensuring it runs smoothly and efficiently.
• Exploit business tools, software and technology to create digital solutions for business process automation and working efficiency improvement.
• Monitor data systems for issues and troubleshoot as necessary.
• Develop and maintain scalable, efficient and reliable data storage solutions
• Optimize database performance and improve query response times
• Develop and maintain data models and schema designs to support business requirements
• Implement and maintain data security and privacy protocols
• Create documentation as project completion report.

Qualifications:

• Bachelor degree in Computer Science, Information Technology or equivalent.
• More than 3 years’ experience in data engineering, data management or related field
• Experience with ETL process, data modeling, data handling, schema design
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
• Experience in data warehouse/data lake development & deployment
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Strong problem-solving skills and attention to detail
• Excellent communication and collaboration skills, team player.
• Experience with ETL tools such as Talend, Informatica or other tools is an added advantage.
• Experience in cloud solution such as AWS, Azure is an added advantage.
• Experience in Financial sector or Insurance sector is an added advantage.