Join our team and build your career with us
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior QA Tester – REMOTE. In this role, you will take charge of leading our automated testing efforts, focusing on innovative AI features and non-deterministic systems. Your expertise will significantly contribute to improving the quality of our AI agents and LLM pipelines. You will collaborate closely with AI researchers and developers to define quality metrics and ensure robust testing strategies. This is a pivotal role that not only enhances product quality but also shapes the future of enterprise automation.
Accountabilities
Own the E2E framework: Build, maintain, and scale our automated testing framework using Playwright (TypeScript/Python).
Test the unpredictable: Design strategies to test non-deterministic LLM outputs, AI agents, and RAG pipelines.
Tackle LLM-specific challenges: Build guardrails and automated checks for prompt drift and hallucinations.
Evaluate Agent behavior: Create scenarios to test how AI agents handle edge cases and multi-step reasoning.
Integrate and collaborate: Wire tests into our CI/CD pipelines, ensuring consistency with AI logic.
Requirements
5+ years in QA Automation or Software Engineering in Test (SDET).
Deep, hands-on experience with Playwright for reliable test suite development.
Strong programming skills in TypeScript, JavaScript, or Python.
Understanding of LLMs and their testing challenges.
Systems thinking for analyzing complex architectures.
Excellent communication skills to explain QA issues clearly.
Benefits
Freedom and ownership of impactful work.
Positive organizational culture focused on personal and professional growth.
Commitment to diversity and inclusion.
Top market compensation package including company shares.
Personal development budget, meal allowance, and recreational activities.
