Job Description

Data Engineer - VCC

Responsibilities

We are seeking a talented Data Engineer to join our Digital Transformation initiative. In this role, you will be pivotal in modernizing our legacy data systems and architecting the next generation of data infrastructure. You will collaborate closely with software engineers to design and implement scalable data pipelines, ensuring efficient real-time data processing and supporting data-driven decision-making across the enterprise.

Collaborate with software engineers to design and implement data pipelines for large-scale data processing.
Work with data scientists to ensure accurate and timely data for analytics and digital insights.
Optimize data storage and processing systems for performance and scalability to handle growing digital demands.
Ensure data quality, consistency, and reliability across legacy and modern cloud systems.
Maintain and improve the data infrastructure to support platform growth and digital adoption.

Requirements

3+ years of experience as a Data Engineer or in a similar role focused on data modernization.
Hands-on experience developing data pipelines (ETL/ELT) using tools such as SAP Datasphere, Dataiku, Airflow, Kafka, or similar platforms.
Familiarity with handling unstructured data and integrating legacy data sources.
Working knowledge of SQL, NoSQL, and vector databases for diverse data storage needs.
Experience with large datasets and basic real-time or streaming data processing frameworks.
Basic understanding of AI/ML data requirements, including data preparation and feature engineering.
Experience with cloud platforms (AWS preferred) and exposure to cloud-native data services.
Some experience supporting AI/ML pipelines (e.g., assisting with training, inference, or model monitoring).
Exposure to MLOps practices and tools, with willingness to learn more advanced techniques.
Experience using containerization tools such as Docker or Kubernetes for data engineering tasks.
Familiarity with RESTful APIs and common integration patterns.
Understanding of data quality checks, monitoring, and validation frameworks.
Ability to collaborate with cross-functional teams in an agile environment.
Strong problem-solving skills and a proactive approach to troubleshooting data issues.
Experience working with secure data architectures and awareness of data governance and compliance best practices.
Proficiency in scripting languages such as Python or Scala for automating data engineering workflows.
Demonstrated ability to support junior engineers and contribute to team technical initiatives.
Good organizational skills with the ability to manage multiple projects and deadlines.
Analytical mindset and attention to detail, ensuring accuracy in data-driven solutions.
Exposure to data cataloging and metadata management solutions.
Ability to communicate technical concepts clearly to both technical and non-technical stakeholders.