Senior/Mid-level Quality Engineering Analyst

Accountabilities:: AI & LLM Testing: Analyze LLM behavior and design rigorous test scenarios that assess the accuracy, consistency, safety, and contextual relevance of AI-generated responses. Functional & Automated Testing: Execute functional, exploratory, regression, and automated tests across conversational flows and APIs to ensure reliable and stable deliveries. Generative AI Validation: Establish validation routines for generative models, identifying and mitigating hallucinations while ensuring AI interactions remain aligned with business contexts. Integration Quality: Investigate integration anomalies, document issues with detailed findings, and collaborate with engineering teams to accelerate resolution and continuous improvement. API Testing: Validate RESTful APIs, integrations, and data flows using appropriate testing tools and techniques. User Experience Validation: Assess the usability, responsiveness, and overall performance of AI-powered journeys to help deliver seamless user experiences. Cross-functional Collaboration: Work within agile environments and maintain strong technical communication and alignment with engineers, designers, and multiple stakeholders. Requirements Quality Engineering Experience: Hands-on experience creating and executing functional, exploratory, and regression tests for complex software flows. Test Automation: Practical experience with test automation frameworks such as Cypress or Robot Framework, ideally within continuous testing environments. AI & LLM Understanding: Ability to translate expected AI and LLM behavior into structured test scenarios that assess safe, accurate, and contextually appropriate interactions. API Testing: Experience testing RESTful APIs with tools such as Postman and validating integrations and data traffic. Generative AI Tools: Comfortable using generative AI and modern productivity tools such as GitHub Copilot to accelerate script development, testing, and troubleshooting. Technical Environment: Practical experience working with cloud environments and querying both relational and non-relational databases. Agile Collaboration: Experience working in agile teams, with the ability to communicate effectively and maintain technical alignment across multiple stakeholders. Benefits Remote Work: Fully remote position based in Brazil, offering the flexibility to work from anywhere within the country. AI-Focused Environment: Opportunity to work directly with LLM-powered conversational experiences and emerging generative AI technologies. Technical Scope: Exposure to software quality engineering, test automation, APIs, cloud environments, databases, and complex integrations. Cross-functional Collaboration: Work closely with engineering, design, and other stakeholders on enterprise-level technology initiatives. Professional Growth: Opportunity to deepen expertise in AI validation, automation, quality engineering, and modern software development practices. Impactful Work: Contribute to the reliability, safety, and effectiveness of AI-driven experiences used in complex customer environments.