You will be the lead analyst for data engineering, analytics and data management in the company. This is a techno-functional role.As a data engineer, you will work with the business analysts to develop business insights into the data via database engineering and ETL tools and methodologies.
You will also work with external database administrators contracted by the Company who will be carrying out day-to-day data administration tasks.
Your Role
- Data engineering
- Design, build and manage data projects
- Discover, elicit and analyse requirements from business analysts
ii. Design and document application and data architectures
iii. Design data engineering pipelines, data analytics, reporting enhancements and business intelligence functionalities and ensure business requirements are fulfilled.
iv. Design and build scripts and code fragments (eg,in SSIS) for data extraction, transformation and loading needs
- Develop SQL databases and writing applications to interface with SQL databases, as well as writing and testing codes and configurations.
vi. Manage the delivery of in-house or outsourced data projects
- Data engineering and maintenance:
- Plan and execute data profiling and data quality analysis
ii. Plan and execute master data maintenance jointly with business users
iii. Plan and execute operational data maintenance jointly with business users, to upkeep data integrity and application fitness-for-purpose.
- Data analysis and Maintenance
- Interpret trends and patterns
ii. Conduct data analysis and report on results
iii. Prepare data for prescriptive and predictive modelling
iv. Build algorithms and prototypes
- Test and Rollout
- To conduct tests (SIT, UAT and other tests) with business users
ii. To rollout new data analysis and business intelligence initiatives to business users
- Data patching and cleansing:
- Carry out and document data cleansing operations periodically to upkeep data quality and fitness for purpose for data warehouses
ii. Carry out data transformation, correction and aggregation operations regularly for data warehouses, or in response to business or regulatory requests
- Database Administration (via contracted Database Administrator)
- Manage external database administrators who will be carrying out the following tasks:
- Database monitoring and performance tuning:
Iii. System Patching And Upgrades
ii. Database operations and administration:
iv. Lifecycle management including overhaul, refactor, upgrade and cloud migration
- Maintain database cybersecurity posture and DR capability maintenance including execution the annual DR exercise to demonstrate that DR capability is operational.
vi. Data architecture and inventory maintenance
- Manage database administration contracts and ensure the vendor f
Domain / areas of coverage
You will be covering systems and processes in the following areas:
- Microsoft SQL databases
- Oracle databases
- MySQL databases
- SQL Server Integration Services
- Enterprise Data Warehouse and Datalake (ODS)
- All data engineering and ETL tools
Your Profile
- A degree in computer science, information systems or equivalent
- At least 5-7 years working experience in data management and data engineering
- The offered job grade/designation will be based on candidate’s experience, competencies and skillsets
Essential
Skills and competencies:
- Experience with business requirement gathering work
- Experience with business requirement gathering work is a must
- Experience with data engineering and development work
- Experience with SQL Server Integration Services
- Experience in the development of database scripts
- Experience in data visualisation and analysis work
- Experience with Enterprise Data Warehouse
Optional
- Experience with Microsoft SQL Server and/or Oracle database administration
- Experience with Python, R, and Machine Learning tools
- Experience with cloud platforms such as Microsoft Azure and other Cloud IaaS, PaaS, SaaS
Certifications
- Data engineering and SQL development certification is a plus
- Project management certification is a plus
- ITIL certification is a plus
Attributes
- Intellectual curiosity and analytical. This role requires the candidate to explore, learn and master the business domain. The candidate must be motivated and with intellectual curiosity to discover and map out the way our business operates.
- Technical detail oriented: Candidate must have keen attention to detail – this is a highly technical role, and candidates must be able to work with technical details.
- Ability to work towards in time-definite outcomes: Candidate must be able to work in time-critical operations environment – this role functions within production operations. There are routines and scheduled events that the candidate must work within.
- Ability to take ownership: This is a subject matter expert and systems ownership role – the candidate must be highly self-motivated, and take responsibility for the systems under his/her charge
Desired Skills and Experience
Machine Learning, Oracle, Data Management, ETL, Data Engineering, SQL Server, Python, Data Architecture, SSIS, Data Analytics