Lead AWS Big Data Engineer ( Python, PySpark, Glue)

MonoSpear logo

MonoSpear

View Salaries, Reviews, and more  

Job Description

Experience: 5-7 Years

Work Type: Contract

Contract Duration: 6 Months (Extendable)

Work Mode: Hybrid

Availability: Immediate

Shift Timings: 10 Am to 7Pm

Budget: up to 15 LPA (Based on Skills, Experience and Current CTC)


Job description.

Mandatory Skills : Primary Skills: Data pipeline , ingest, transform, and deliver using S3, Glue, RDS, Redshift, Athena, Lambda, SQL, Python, Spark (mandatory). (Real 2-3 projects as AWS data engineer ) Knowledge In Implementing ETL / ELT for data solutions - CDC, Data Modelling, Data Governance AWS Solutions Architect or AWS Developer Certification required , Secondary skills: Cloud Formation templates, CI/CD, Jenkins, Cloud watch Implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model Amazon Kinesis, AWS Managed Airflow and AWS Managed Kafka Good to have (Not Mandatory)

Detailed Job Description

1. Designing, building, and maintaining efficient, reusable, and reliable code

2. Ensure the best possible performance and quality of high scale data applications and services

3. Participate in system design discussions

4. Independently perform hands on development and unit testing of the applications

5. Collaborate with the development team and build individual components into enterprise data platform

6. Work in a team environment with product, QE/QA, and cross functional teams to deliver a project throughout the whole software development cycle.

7. Responsible to identify and resolve any performance issues

8. Keep up to date with new technology development and implementation

9. Participate in code review to make sure standards and best practices are met

10. Project management: Agile developers take responsibility for estimating, planning, and managing all tasks and report on progress

11. Software quality: The Agile developer is also responsible for the quality of the software he/she produces. The team takes responsibility for the quality of the work they produce instead of turning over some code to a separate and independent group for testing

12. Teamwork: This includes collaboration with all other team members with the aim to take shared responsibility for the overall efforts

13. Understanding user needs: This is about interacting with users as necessary to clarify requirements



Python pyspark- Band 7A, 7B

AWS Services Glue, RDS, Redshift, Lambda and S3

Python, Spark & SQL Knowledge.

Experience in 2 to 3 real projects as a AWS Big Data Engineer

Detailed skill requirements from client

Primary Skill: Data pipeline , ingest, transform, and deliver using S3, Glue, RDS, Redshift, Athena, Lambda, SQL and performance tuning, Python, Spark , (mandatory). (Real 2-3 projects as AWS data engineer),

Knowledge In Implementing ETL / ELT for data solutions - CDC, Data Modelling, Data Governance, AWS Solutions Architect or AWS Developer Certification required,

Secondary Skill: Cloud Formation templates, CI/CD, Jenkins, Cloud watch, Implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model, Amazon Kinesis, AWS Managed Airflow and AWS Managed Kafka

Nice to have: Conceptual knowledge on Azure Data, MS Fabric, MS PowerBI. This could be just training and awareness.


Interview Questions of Lead AWS Big Data Engineer ( Python, PySpark, Glue) at MonoSpear

Currently, there aren't any interview questions for this role at MonoSpear shared by other job seekers.
View more interview questions of similar roles from other companies โ†’
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Salary Insights of Lead AWS Big Data Engineer ( Python, PySpark, Glue) at MonoSpear

Currently, there aren't any salaries for this role at MonoSpear shared by other job seekers.

View more salaries from MonoSpear โ†’

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now