Software Engineer, AI/ML, Google Cloud

Google logo

Google

View Salaries, Reviews, and more  

Job Summary


Job Type
-

Seniority

Years of Experience
Information not provided

Tech Stacks
Python Google Cloud C++

Job Description

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.
  • 2 years of experience programming in Python or C++.
  • 2 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
  • 2 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
  • 2 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization , data processing, debugging).

Preferred qualifications:

  • Experience with JAX transformations (vmap, pjit, grad) and the underlying XLA compiler stack.
  • Experience reading high level optimizer (HLO) code to understand exactly how Python code translates to hardware execution is highly valued.
  • Understanding of theoretical quantization and quantization techniques (PTQ, QAT, weight-only vs. activation) and low-precision numerics (int8, fp8, int4), and the mathematical implications of compression on model convergence.
  • Ability to interpret low-level performance tools (e.g., xprof, TensorBoard) to identify padding issues, memory fragmentation, or SIMD utilization gaps, profiling and optimizing ML models on TPUs or GPUs.

About the jobIn this role, you will be tasked with not only maintaining the library but proactively evolving it. You will move beyond simple bug fixing to explore experimental quantization algorithms, adding them to the library before customers even realize they need them.

You will operate in a unique environment where you must balance the agility of open-source software with the reliability required by Google-scale production. You will need to obsess over both quality (preserving model accuracy) and performance (optimizing runtime). You will need to be comfortable deep-diving into low-level profiles to debug TPU/GPU bottlenecks, while simultaneously possessing the soft skills to communicate effectively with partner teams in Google DeepMind (GDM) and customer teams across Search and Ads. You will be defining how the world optimizes JAX models.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $147,000-$211,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google .

Responsibilities

  • Design and implement new quantization features (e.g., post-training quantization (PTQ), quantized training (QT), and on-device machine learning (ODML) support)) to keep pace with the rapidly evolving JAX ecosystem.
  • Proactively research and implement experimental quantization algorithms (e.g., int2 numerics, dual scale quantization, hadamard transformation) to lead customer adoption rather than just reacting to requests.
  • Debug and optimize low-level performance issues. Use accelerated linear algebra (XLA) profiling tools (xprof) to analyze TPU/GPU execution traces, identify bottlenecks, and ensure the lowest-cost implementation of algorithms.
  • Manage the health of the codebase across two fronts: resolving issues on the public repository and triaging high-priority bugs for internal partners.
  • Write high-quality documentation, tutorials, and examples for the open-source community to lower the barrier to entry for new users.


Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form .

Interview Questions of Software Engineer, AI/ML, Google Cloud at Google

Interview questions from Google that are similar to Software Engineer, AI/ML, Google Cloud
View more interview questions from Google →
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Salary Insights of Software Engineer, AI/ML, Google Cloud at Google

Currently, there aren't any salaries for this role at Google shared by other job seekers.

View more salaries from Google →

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now