PySpark Technical Lead

Sopra Steria logo

Sopra Steria

View Salaries, Reviews, and more  

Job Summary

โ‚น62,500 - โ‚น130,556 / Monthly EST

Job Type


Years of Experience
Information not provided

Tech Stacks
Python Hadoop Scala SQL kafka Spark Airflow Hive Azure Git Databricks Apache pySpark CI Apache Nifi Spark Streaming SparkSQL Factory yarn

Job Description

Company Description

About Sopra Steria

Sopra Steria, a major Tech player in Europe with 56,000 employees in nearly 30 countries, is recognised for its consulting, digital services and software development. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a fully collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2023, the Group generated revenues of โ‚ฌ5.8 billion.

The world is how we shape it.

Job Description

Required Skills:

  • Strong expertise of programming languages โ€“ Python/Scala/others
  • Hands-on experience in PySpark including Data frame core functions SparkSQL, Spark Streaming and with HIVE, Hadoop, Kafka, YARN.
  • Good Experience in
  • Big data cloud platform, preferably Azure.
  • Databricks and coding with notebooks.
  • Airflow, Apache NiFi
  • processing and manipulating data using SQL and Python code.
  • Professional experience implementing data ingestion pipelines using Data Factory.
  • Building and optimizing data pipelines, architectures, and data sets.
  • Working knowledge of queueing, stream processing, and highly scalable data stores
  • User training, customer support, and coordination with cross-functional teams.
  • Writing database-heavy services or APIs.
  • Strong understanding of structuring code for testability.
  • Should be able to perform estimations, lead the team technically, Monitoring & Tracking of activities.
  • Should be able to coordinate and communicate well with customer.

Good To Have

  • Professional Data Engineer Certifications in Data Bricks.
  • Familiarity with GIT workflow, CI/CD Pipelines.
  • Working Knowledge of Azure DevOps environment.
  • Experience of Agile practices & methodologies.
  • Experience on Migration projects (Scala/PySpark).
  • Flexibility to work in both support and development projects

Total Experience Expected: 06-08 years


B.E./ B.Tech./ MCA

Additional Information

At our organization, we are committed to fighting against all forms of discrimination. We foster a work environment that is inclusive and respectful of all differences.

All of our positions are open to people with disabilities.

Interview Questions of PySpark Technical Lead at Sopra Steria

Interview questions from Sopra Steria that are similar to PySpark Technical Lead
View more interview questions from Sopra Steria โ†’
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now