Job Title: TEST ENGINEER L3
Agent & Functional Testing
- Design and execute tests for agent goals, reasoning, decisions, memory, context, tool selection and task execution.
- Validate orchestrator routing, delegation, sequencing, retries, hand-offs, termination and multi-agent interactions.
- Test APIs, workflows, integrations and end-to-end business scenarios.
AI Evaluation & Test Data
- Build and maintain golden datasets
- Validate accuracy, relevance, groundedness, consistency
- Implement automated evaluation using deterministic checks, similarity metrics, LLM-as-judge and defined quality thresholds.
- Analyze failures and distinguish AI variability from genuine product defects.
Guardrails & Responsible AI
- Test input/output, tool-use, data-access and action guardrails.
- Validate prompt injection, jailbreak, unauthorized access, data leakage and excessive agent autonomy scenarios.
- Test hallucination, bias/fairness, groundedness, explainability, privacy, safety and traceability.
- Validate rogue or goal-misaligned agent behavior and human oversight controls.
Non-Functional Testing
- Execute performance, scalability, resilience, security, privacy and usability tests.
- Validate logs, traces and observability across agent and model interactions.
Automation & Quality Engineering
- Build reusable automated tests.
- Perform defect analysis, root-cause investigation and regression validation.
- Maintain test results, quality metrics and evidence supporting release readiness.
Tools & Technology
- AI evaluation: LangSmith, DeepEval, RAGAS, Arize Phoenix, Braintrust, Langfuse or equivalent.
Mandatory Skills: NetOxygen toolkit .
Experience: 3-5 Years .
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.