· Role: AI DevOps Engineer
· Experience: 5 – 9 years
· Qualification: Bachelor’s degree in computer science, computer engineering, IT, Data Science
· Location: Pune or Remote India only
Role Overview
We are seeking a skilled and proactive AI DevOps Engineer to design, implement, and manage scalable infrastructure and deployment pipelines for AI-driven applications. The ideal candidate will have strong expertise in Kubernetes, cloud platforms, and CI/CD practices, along with hands-on experience in managing LLM-based workloads and GPU-enabled environments.
Key Responsibilities:
· Design, deploy, and manage highly available and scalable infrastructure for AI/ML applications.
· Build and maintain Kubernetes clusters (EKS/OKE) with a focus on performance, scalability, and reliability.
· Develop and manage Helm charts, ingress controllers, and optimize networking configurations.
· Implement and manage CI/CD pipelines using Jenkins, ArgoCD, and GitOps methodologies.
· Deploy and manage LLM serving frameworks such as vLLM, Ollama, and Open WebUI.
· Optimize GPU resource allocation and utilization in containerized environments.
· Automate infrastructure provisioning using Terraform and manage cloud-native services.
· Integrate security best practices into DevOps workflows, including automated vulnerability scanning and remediation.
· Monitor system performance and reliability using Prometheus, Grafana, Loki, and Alertmanager.
· Collaborate with development and AI teams to build developer-friendly automation tools and workflows.
Required Skills & Qualifications:
· Deep expertise in Kubernetes (EKS/OKE) including cluster management, networking, and scaling.
· Strong experience with CI/CD tools such as Jenkins and ArgoCD.
· Proficiency in AWS (mandatory); experience with OCI is a plus.
· Hands-on experience with Infrastructure as Code tools like Terraform.
· Experience in deploying and managing LLM-based systems (vLLM, Ollama, Open WebUI).
· Strong understanding of containerization and orchestration (Docker, Kubernetes).
· Experience with monitoring and logging tools like Prometheus, Grafana, Loki.
· Solid understanding of security practices including vulnerability management tools like Veracode and Trivy.
About RIA Advisory:
RIA Advisory LLC (RIA) is a business advisory and technology company that specializes in the field of Revenue Management and Billing for Banking, Payments, Capital Markets, Exchanges, Utilities, Healthcare and Insurance industry verticals. With a highly experienced team in the field of Pricing, Billing & Revenue Management, RIA prioritizes understanding client needs and industry best practices to approach any problem with insight and careful strategic planning. Each one of RIA Advisory's Managing Partners have over 20 years of industry expertise and experience, our leadership and consulting team demonstrate our continued efficiency to serve our clients as a strategic partner especially for transforming ORMB and CC&B space. Our operation are spread across US, UK, India, Philippines, Australia.
• Services Offered: • Business Process Advisory for Revenue management processes • Technology Consulting & Implementation • Help clients transition to latest technology suite and overcome business problems. • Managed Services • Quality Assurance • Cloud Services
• Product Offered: • Data Migration and Integration Hub • Data Analytics Platform • Test Automation • Document Fulfilment • Customer Self Service
• Top Industries/Verticals: • Financial Services • Healthcare • Energy and Utilities • Public Sector Revenue Management.
Currently, there aren't any salaries for this role at RIA Advisory shared by other job seekers.
View more salaries from RIA Advisory →Achieve your dream job with our top-notch tools!
Resume Checker
Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!
AI InterviewPrep
Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!
Resume Builder
Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!