Data Engineer

Encora logo

Encora

View Salaries, Reviews, and more  

Job Description

  • Build and support data lake, data warehouse and data API based solutions in Singapore by using suitable technology
  • Document data solutions, standards, requirement specifications, and business processes
  • Design, develop and implement secured, reliable, cost effective and high performance ETL solutions using Python, Pyspark and Talend
  • Perform unit testing, design & support integration testing strategies and automate data quality monitoring
  • Develop good understanding of existing data sets and data model
  • Develop good understanding of existing solutions and be able to support and enhance them
  • Establish and follow best practices in code version control & deployment and help to reduce the deployment time
  • Monitor scheduled jobs and reduce BAU monitoring efforts by automation
  • Take ownership and manage timely completion of deliverables
  • Maintain good documentation of the solutions and effectively communicate stakeholders about the value added
  • Minimum 5 years of professional experience in big data, data warehousing, operational data stores, and large-scale architecture and implementations
  • Ability to understand and write SQL
  • Ability to work with SQL/NOSQL database management systems and data warehouses
  • Hands on experience in AWS/Azure/Google cloud services
  • Using distributed computing frameworks like Apache spark using python or scala
  • Developing data processing python programs based on Pandas and related libraries
  • Knowledge in orchestration tools like Apache Airflow or similar tools
  • Good experience in ETL tools like Talend, Informatica or DataStage
  • Knowledge in stream processing frameworks like Apache Kafka or AWS Kinesis or similar frameworks
  • Using Change data capture systems like IBM Infosphere CDC or Attunity or AWS DMS or similar tools
  • Shell scripting to automate tasks


banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Resume Checker Illustration

Interview Preparation

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Let's Prepare
Resume Checker Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Build Resume