AI Tester

Skills : AI Tester

Experience : 12+ Years

Location : All LTIM Office

Key Responsibilities

Functional & Model Testing

• Design and execute test cases for AI/ML models, including classification, NLP, recommendation, and generative AI systems
• Validate model outputs for accuracy, consistency, and expected behavior across diverse inputs
• Perform regression testing after model updates, retraining cycles, or data changes

Prompt & LLM Testing

• Develop and maintain prompt test libraries for large language model (LLM)-based features
• Evaluate model responses for relevance, tone, factual accuracy, and adherence to business rules
• Identify hallucinations, response drift, and edge-case failures in generative outputs

AI Safety & Red Teaming

• Conduct adversarial testing to identify vulnerabilities such as prompt injection, jailbreaks, and unintended model behaviors
• Assess outputs for bias, fairness, and compliance with responsible AI principles
• Document risk findings and collaborate with model teams to drive remediation

Test Automation & Tooling

• Build and maintain automated test suites for AI pipelines using Python-based frameworks
• Integrate AI testing into CI/CD workflows and contribute to evaluation infrastructure
• Track and report quality metrics, model performance benchmarks, and defect trends

Collaboration & Documentation

• Partner with data scientists, ML engineers, and product teams throughout the development lifecycle
• Write clear test plans, defect reports, and evaluation summaries
• Contribute to internal QA standards and best practices for AI systems