What you will do
- Perform manual testing of web applications to identify bugs, glitches, and inconsistencies;
- Develop, maintain, and execute detailed manual test cases based on product requirements and specifications;
- Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.;
- Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements;
- Design and execute test scenarios to verify AI behavior, including prompt–response consistency, contextual relevance, and deterministic vs. non-deterministic outputs;
- Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate);
- Conduct manual API testing to validate request/response accuracy, error handling, and integration;
- Use TestRail to create, manage, and track test plans, test cases, and test execution results;
- Use Jenkins CI/CD pipelines;
- Report and document defects clearly using the bug tracking system (JIRA);
- Participate in daily stand-ups, sprint planning, and other Agile team meetings;
- Review user stories and acceptance criteria to understand the scope of testing;
- Estimate own tasks, report on risks to the team lead;
- Collaborate with developers and other QA team members to reproduce issues and verify fixes;
- Maintain and update test documentation as needed.
Must haves
- 2+ years of experience with manual testing;
- Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models;
- Knowledge of Testing and Quality Assurance Processes;
- Strong experience with Test Design activities to cover a set of product requirements;
- Knowledge of Test Design techniques;
- Knowledge of testing methodologies;
- Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes;
- Experience with Postman (API testing) and Browser developer tools;
- Experience with UI testing;
- Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles;
- Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain);
- Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization);
- Experience with TestRail as a Test Management system (as a user, test execution is required);
- Basic understanding of CI/CD process;
- Upper-intermediate English level.
Nice to haves
- Experience with SSO testing;
- Experience in Performance or Load.
About the project
The benefits of joining us
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
Flextime
Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
Your AgileEngine journey starts here
2 min
Tell us about yourself
2 sec
Confirm requirements
30 - 60 min
Pass a short test
5 min
Record a short video
→ Introduce yourself on a video, instead of waiting for an interview
Live interview
Ace the technical interview with our team
→ Schedule a call yourself right away after your video is reviewed
Live interview
Final interview with your team
→ Get to know the team you will be working with
Get an offer
As quick as possible
