Job Description
Job Title: AI Automation Engineer
Location- Bellevue (Seattle area), WA
Job Description:
- Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
- Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
- Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
- Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.
Must Have Skills:
• Experience with LLM Evaluation frameworks like Promptfoo, DeepEval, Ragas etc
• Handon experience with AI Automation frameworks using Python PyTest, Unittest
• Experience with Load and performance testing using Locust, Jmeter etc.
Good to have skills
- AIOps/MLOps knowledge
- Observability for AI
- Experience working on projects for Telecom operators like T-Mobile, AT&T, Verizon or OSS/BSS area,
Experience
- Overall IT experience: Minimum 10 years
- AI Experience- 3 Years
Soft Skills
- Ability to work in fast-paced, multi-disciplinary, data-driven environments.
- Work closely with offshore teams with some overlap with IST.
- Excellent stakeholder management
Mandatory Skills: Autonomous Network AI Engineering .
Experience: 8-10 Years .
The expected compensation for this role ranges from $100,000 to $180,000 .
Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.
Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.
Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.
Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.