Senior Data Engineer

Quantiphi logo

Quantiphi

View Salaries, Reviews, and more  

Job Description

Role Description & Requirements:


Minimum experience : 4-10 years

In-depth knowledge and experience of GCP Data services : Bigquery, Dataproc, Composer, Pubsub, Dataflow, GCS and BigTable

Must have proficient experience in GCP Databases : Bigtable, Spanner, CloudSQL and AlloyDB

Solid understanding and experience of relational database concepts and technologies such as SQL, MySQL, PostgreSQL or Oracle.

Familiarity with database performance tuning, optimization, and troubleshooting techniques is a plus

Strong working experience on one or more of the Big Data/Hadoop distributions(or ecosystems) like, Cloudera/Hortonworks, Kafka, Hive, Spark etc

Good understanding of Native and external tables, with different file formats : Avro, ORC, Parquet

CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform

Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog)


Tools and languages experience Required:


Must have:

GCP Dataflow, Pub/Sub, Cloud Composer, Cloud Workflow, BigQuery, Cloud Run, CloudBuild, Scala, Spark, Spanner, CloudSQL

Programming knowledge and willingness to be hands-on - Python, Java

Specialization on streaming such as PubSub or Kafka or equivalent


Good to Have:

Hands-on experience with other cloud platforms and services such as AWS RDS, or Azure SQL Database, Azure HDInsight, IBM Open platform

Good understanding of the following AWS Data services, Redshift, RDS, Athena or SQS/Kinesis

Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus

Good to have GCP Professional Data Engineer Certification


Interview Questions of Senior Data Engineer at Quantiphi

Interview questions from Quantiphi that are similar to Senior Data Engineer
View more interview questions from Quantiphi โ†’
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now