Role Description
Role: QA Engineer - Expert Database
Technology Stack: Azure SQL | REST APIs | Azure AI Search | OpenAI (LLM)
Role Overview
QA support for a system that ingests data from emails, enriches and processes it, stores expert records, and enables search functionality. The primary focus is on search, data accuracy, record integrity, integration validation, and end-to-end workflow testing, along with functional UI validation.
Roles & Responsibilities
- Perform end-to-end functional testing of the Expert Database platform
- Validate transformation of unstructured calendar/email data into structured database records
- Test entity extraction, normalization, and deduplication logic
- Validate SQL-driven structured filtering and stored procedure outputs impacting search behavior.
- Conduct API testing (ingestion and search endpoints), including boundary and negative scenarios
- Validate hybrid search functionality (LLM + Azure AI Search + SQL filters)
- Assess search relevance, ranking accuracy, and structured filter behavior
- Execute regression testing after system or prompt/embedding updates
- Perform performance, load, and latency testing
- Develop and maintain automated regression suites where appropriate
- Maintain test cases and defect logs with priority and severity classification and provide QA sign-off
Required (Must Have) Skills
Proven 5+ years of experience in end-to-end functional and system testing
Strong SQL proficiency, including writing queries and validating stored procedure outputs
Hands-on experience in API testing (REST APIs using Postman, Swagger, or equivalent tools)
Strong test case design, execution, and documentation capability
Experience building and maintaining regression test suites (manual and/or automated)
Strong analytical thinking and structured problem-solving skills
Ability to test complex, multi-layer systems and trace defects across components
Clear written and verbal communication skills
Good To Have Skills
Experience validating AI/LLM-powered applications or semantic search systems
Familiarity with hybrid search architectures (vector search, keyword search, structured filtering)
Experience testing applications built on Azure cloud infrastructure
Exposure to performance, load, and latency testing tools and methodologies
Skills
quality assurance,azure sql,rest api,end-to-end functional testing,system testing,