Skip to content

QA Automation Lead · Agentic AI quality

AI makes shipping fast. Quality makes it worth it.

AI Quality & QA Automation Lead | Playwright Expert

Helping engineering teams own quality: QA leadership, agentic QA and test automation infrastructure, so they ship fast and still trust every release.

Read the blog → Work with me
Portrait of Anjali Pawar
12+ yrsbuilding quality
95%test coverage built
5d → 10hregression cycle after automation

01 · About

Quality by instinct. Engineer at the core. Builder of teams that ship.

12+ years engineering quality into SaaS platforms that scale to 100 million users globally — across startup, acquisition, and enterprise scale.

Started as a tester because I was curious about why software breaks. Stayed because I realised fixing the process was more interesting than fixing the bug.

Over a decade, the work kept expanding — and so did the scope of what "QA" actually meant in practice. It was never just writing test cases. Every sprint, I was in planning sessions translating business requirements into test coverage decisions. Every release, I was the one coordinating across Product, Engineering, and DevOps to define what "ready to ship" actually meant. Every quarter, I was building documentation, onboarding playbooks, and team processes that outlasted any single test suite.

That's when I realised: I wasn't just a QA engineer. I was managing programs.

The skills came naturally from the work. Backlog management — because someone had to own the test debt and prioritise what got automated first. Stakeholder communication — because QA sits at the intersection of every team and someone had to translate between engineering reality and business expectations. Risk management — because every release is a risk decision, and I was the one making the case for what we could and couldn't ship. Team leadership — because scaling a QA function from one person to twelve means hiring, mentoring, and building a culture of quality, not just a suite of tests.

Now working on both sides of AI quality. Using AI to test better: built an AI-powered QA agent on Playwright MCP, and a test failure finder that tells real regressions apart from automation, environment and performance issues. Testing AI itself: building a RAG application evaluated with DeepEval and Promptfoo.

03 · Expertise

The toolkit behind quality that ships.

From test automation and CI/CD to AI evaluation and QA leadership, the tools and practices behind quality delivery.

Test Automation Frameworks

  • Playwright
  • REST Assured
  • Selenium

Programming & CI/CD

  • Java
  • Python
  • JavaScript
  • Jenkins
  • Docker
  • Git
  • GitHub Actions

API Testing & Database

  • REST API
  • Postman
  • Swagger
  • SQL
  • MongoDB

AI & Quality Engineering

Current focus

  • Claude
  • Cursor
  • GitHub Copilot
  • Playwright MCP
  • AI-Assisted Testing
  • Prompt Engineering
  • LLM Quality Evaluation
  • DeepEval
  • Promptfoo
  • Non-Deterministic Testing (LLM-based systems)
  • TestRigor
  • AI Workflow Automation

Leadership

  • Team Leadership & Mentoring
  • Stakeholder Communication
  • Cross-Team Collaboration
  • Program Delivery
  • OKR Alignment

Test Strategy & Management

  • Risk-Based Testing
  • Shift-Left Testing
  • Quality Gates
  • Agile
  • Scrum
  • SDLC
  • Sprint Planning
  • Release & Risk Management
  • Go/No-Go Decisions
  • Roadmap Execution

Tools

  • Jira
  • TestRail
  • Allure
  • BrowserStack
  • Confluence
  • Bugsnag
  • Grafana
  • Kibana
  • New Relic

04 · Projects

Built to demonstrate.

01

Playwright MCP Test Agent

An AI-driven testing workflow using Playwright MCP and Claude to autonomously generate, execute, and evaluate test scenarios for web applications. Exploring self-healing locators, natural language test generation, and autonomous QA agents that reduce manual intervention in the testing lifecycle.

Playwright MCPCursorAI TestingPython
View on GitHub ↗
02

Test Failure Finder

When an automation test fails mid-sprint, is it a real regression, a flaky test, the environment or performance? This tool pulls together the Jira ticket, the PR diff, Allure results with run history and the sprint's open bugs, then works out which changed files actually relate to the failure. An LLM turns that evidence into a short report: cause, risk, evidence and what to investigate next. Next up: Promptfoo evals to check the AI's classifications can be trusted.

JavaCursorJira APIGitHub APIAllurePlaywright
View on GitHub ↗
03

Playwright Java Automation Framework

End-to-end UI automation framework built with Playwright and Java targeting a live web application. Implements Page Object Model for maintainability, Allure Reports for rich test reporting, and Jenkins CI/CD pipeline for automated execution on every build.

PlaywrightJavaJenkinsAllure ReportsCI/CD
View on GitHub ↗
04

AI-Assisted Portfolio Development

Built this portfolio site using AI-assisted development, collaborating with Claude by Anthropic to design content architecture, write technical copy, and make platform decisions. Demonstrates practical application of AI tools in a real engineering workflow.

Claude AIGitHub ActionsGitHub PagesPrompt Engineering
View on GitHub ↗
05 In progress

RAG Policy Assistant

A RAG assistant that answers questions about product requirements and policies, grounded in the source documents. Built to be tested: a DeepEval and Promptfoo suite will check answer faithfulness, retrieval quality, hallucinations and regressions whenever the prompt or model changes.

RAGDeepEvalPromptfooLLM EvaluationPython
06 In progress

AI Food & Fitness Companion

One conversational AI web app for meal planning, Indian home-cooked recipes, exercise suggestions and progress tracking, instead of switching between separate apps. Answers grounded in a curated Indian food catalogue and trusted health references, with every recommendation explained. Every AI answer will be graded by an LLM-as-a-Judge for grounding, safety and fit with the user's preferences.

Conversational AIRAGGuardrailsLLM-as-a-Judge

05 · Experience

12 years of quality, from first test to founding QA.

Jan 2026 - Present

Founding QA

Stealth startup

Owns quality end to end as the first QA hire, from requirements to deployment. Built the test automation framework from the ground up and set the test strategy for AI features, including evaluating non-deterministic LLM output. Works directly with founders, Product and Engineering, and makes the release calls.

  • AI quality testing
  • Framework built from scratch
  • Requirements → deployment

Nov 2023 - Nov 2025

Lead QA Specialist

Cornerstone OnDemand

Led a 12-member QA team and owned QA strategy across every sprint, partnering with Product, DevOps and leadership on what "ready to ship" meant. Set the team's technical direction and OKRs, and took a manual-only QA function to full Playwright automation wired into CI/CD.

  • 85% test coverage
  • Regression 5 days → 10 hours
  • 40% fewer post-release bugs

Jun 2016 - Oct 2023

Senior QA Engineer

EdCast

Built UI and API automation for an enterprise SaaS product used globally: a reusable REST Assured framework and 300+ Playwright scripts. Fixed 200+ flaky failures to make the suite trustworthy, and mentored 3 junior engineers.

  • 300+ Playwright scripts
  • Suite reliability 65% → 90%
  • API testing time cut 50%

May 2014 - May 2016

QA Engineer

WAGmob

Built test coverage across mobile, desktop and web from the ground up, with requirement traceability backing every sign-off. Worked closely with developers on defect triage to keep releases moving.

  • 500+ test cases
  • Android, iOS and web
  • 95% of high-priority bugs fixed in-sprint

06 · Credentials

Certified, from test to AI.

Udemy · Jan 2023

REST API Testing - REST Assured Java

Udemy · Dec 2024

Mastering Core Java

Anthropic · Apr 2026

AI Fluency - Framework and Foundations

Amazon Web Services · Aug 2026

AWS for Beginners

Bachelor of Engineering - Electronics and Communication · Rajiv Gandhi Proudyogiki Vishwavidyalaya University, India · 2009 - 2013

07 · Contact

Quality that keeps up with AI. Let's build it.

Hiring for QA leadership, test automation or AI quality? Open to global and remote roles.

Email Request Résumé LinkedIn ↗ GitHub ↗