GenAI QA Analyst

GenAI QA Analyst

Location: PCS CHE, Chennai

Years of Experience: 5-7 Years

Job Summary: The GenAI QA Analyst ensures the quality, reliability, and compliance of generative AI solutions deployed across enterprise environments. This role is critical in validating AI-driven outputs, monitoring system performance, and ensuring that solutions meet both technical and business expectations. Positioned at the intersection of technology and business, the analyst works closely with delivery leads, developers, and product owners to safeguard the accuracy, scalability, and ethical use of AI applications.

Responsibilities

• Collaborate with delivery leads and product owners to define QA strategies for generative AI projects.
• Design and execute test plans that validate AI outputs for accuracy, consistency, and compliance.
• Conduct both automated and manual testing to evaluate AI models across diverse business scenarios.
• Monitor AI system performance using enterprise tools, ensuring proactive detection and resolution of issues.
• Validate integration of AI platforms into enterprise workflows, ensuring seamless adoption and reliability.
• Ensure GitHub Copilot–driven development aligns with QA standards and supports reproducible outcomes.
• Document QA findings in clear, business-readable formats for stakeholders.
• Advocate for continuous improvement in AI testing practices and promote a quality-first culture across teams.
  
  

Mandatory Skills

• GitHub Copilot (Expert)
• Generative AI Testing Frameworks (Advanced)
• Automated QA Tools & Scripting (Advanced)
• AI Model Validation Techniques (Advanced)
• Performance Monitoring (Dynatrace Davis) (Intermediate)
  
  

Preferred Skills

• AI Foundry
• Microsoft Copilot Studio
• Atlassian Rovo
• Claude Code
• Documentation & Reporting Tools
  
  

Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience in Quality Assurance, particularly in AI/GenAI-focused projects.