Quality Assurance Test Analyst

Envision Employment Solutions is currently looking for a Quality Assurance Test Analyst for one of our partners, a global leader in consulting, digital transformation, technology and engineering services.

Job Summary:

The QA Analyst plays a critical role in executing and automating functional and non-functional testing for Generative AI-driven applications. This role ensures AI models, APIs, and user interfaces are reliable, scalable, and secure by implementing robust test cases and automation frameworks.

Responsibilities:

Functional Testing

• Execute end-to-end (E2E), integration to validate AI-driven actions and ensure that the product functions correctly as per the specified requirements.
• Validate workflows, user journeys, API interactions, and AI model outputs align with business logic.
• Conduct UI/UX testing to validate accessibility, responsiveness, and usability across devices and browsers.
• Support user acceptance testing activities.

Data and AI Model Validation

• Validate input datasets for training, testing, and fine-tuning of AI models.
• Ensure data integrity, preprocessing workflows, and real-world alignment of synthetic data.
• Validate data pipelines and data flow between the AI model, backend services, and frontend.
• Test models against predefined scenarios, including edge cases and adversarial inputs.

Non-Functional Testing

• Support performance, load, and stress testing using tools such as JMeter.
• Simulate heavy traffic and concurrent users to test scalability.
• Benchmark against service-level agreements (SLAs).
• Test for vulnerabilities in data handling, API endpoints, and the AI model.
• Ensure secure handling of sensitive data (e.g., input/output data used in AI processes).

Deployment and Post-Deployment Testing

• Automate test cases for regression and frequent deployments.
• Validate new builds, releases, and updates continuously.
• Track defects, log issues, and verify fixes in collaboration with development teams.
• Monitor production model performance and analyze results for quality improvements.

Automation & API Testing

• Implement test automation for functional and regression testing using Selenium, Cypress, and Robot Framework.
• Conduct API testing using Postman, SoapUI to validate backend service interactions.
• Assist in security and compliance validation, ensuring data protection and regulatory adherence.

• 3–5 years of experience in quality assurance, with a focus on functional and integration testing.
• Proficiency in test automation tools (Robot Framework, Selenium, Cypress) and API testing (Postman, SoapUI).
• Strong knowledge of AI model validation techniques and data integrity testing.
• Familiarity with performance testing tools (e.g., JMeter) and security best practices.
• Experience working in agile environments with CI/CD pipeline integration.
• Strong analytical skills with attention to detail in test execution and reporting