Big data engineer

Web Synergies logo

Web Synergies

View Salaries, Reviews, and more  

Job Description

JD:
Big Data Developer
 Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust
 Experience in designing application solutions in hadoop ecosystem
 Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark
 HDFS file formats and their use cases (eg Parquet, ORC, Sequence etc)
 Good knowledge in data warehousing system
 Experienced in any scripting language (SHELL, PYTHON)
 HortonWorks distribution and understanding on SQL engines (Tez, MR)
 Java/RestServices/Maven experience is a value addition
 Control-M development. Monitoring Resource utilization using Grafana Tool
 Good skillset to create automation scripts in Jenkins & knowledge in working on automating builds, test frameworks, app configuration etc
 Experience in implementing scalable applications with fully automated deployment and control using Bitbucket, Jenkins, ADO etc
 Skillset:
o Mandatory: Big Data – Hive, HDFS, Spark, Scala, Pyspark.
o Good to have : Schedulers (Control-M), ETL Tool – Dataiku , Unix/Shell scripting , Knowledge of Integration services of FileIT/MQ and others , CI/CD tools – Jenkins, Jira, ADO Devops – tools suite , Oracle .


Interview Questions of Big data engineer at Web Synergies

Currently, there aren't any interview questions for this role at Web Synergies shared by other job seekers.
View more interview questions of similar roles from other companies →
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now