Quality Engineer – Automation & AI

About DevRev

At DevRev, we're building the future of work with Computer – your AI teammate. Unlike traditional tools, Computer unifies all your data sources, tools, and workflows into a single AI-ready platform, giving employees real-time insights, proactive suggestions, and powerful agentic actions. It extends your existing software with AI-native apps and agents that work alongside your teams and customers – updating workflows, coordinating across teams, and eliminating repetitive work

• We call this Team Intelligence: human-AI collaboration that breaks down silos, brings people back together, and frees you to solve bigger problems. Backed by Khosla Ventures and Mayfield with $150M+ raised, DevRev is trusted by global companies across industries.

About the role

We are looking for a Quality Architect/Lead with hands-on experience building quality systems and has deep expertise in building and scaling test automation frameworks.The role requires an individual who applies systems thinking to solving complex problems. They should be able to understand the product from various perspectives and be able to effectively create testing programs that validate not just functionality but performance, reliability and user experience.DevRev is building a next generation AI native product that requires us to build novel test systems for the Agent AI platform. The role is mult-faceted and is going to continuously evolve with time.

What you'll do

• Test Case Design and Documentation

• Actively use AI and intelligent agents to accelerate test generation, test maintenance, and coverage expansion.

• Leverage LLMs to convert requirements, user stories, and production incidents into high-quality automated test cases.

• Reduce reliance on manual test case creation by introducing AI-assisted automation workflows, with human review and ownership.

• Apply AI to optimize test selection, prioritization, and execution based on risk, code changes, and historical failures.

• Use AI to assist in identifying missing scenarios, edge cases, and negative paths from requirements and user behavior.

• Maintain strong traceability between product features, test cases, and automated coverage, with AI support for documentation updates and gap analysis.

Test Suite Development

• Create frameworks and standards that help AI create deterministic and stable tests

• Establish coding standards, branching strategies, and review guidelines for automation code.

• Integrate test execution into CI/CD pipelines with fast feedback loops and real-time reporting.

• Design and Build tools that help with test generation, flakiness detection, self-healing tests, and intelligent exploratory testing

• Champion shift-left testing by working closely with engineering, product, and DevOps teams to prevent defects early.

Quality Ownership and Continuous Improvement

• Own the health and evolution of the automation framework.

• Build AI systems that triage test failures, flaky behavior, and production escapes

• Continuously improve testing strategies based on learnings from releases, incidents, and customer impact.

• Promote a strong quality mindset where AI is used as a force multiplier, not a shortcut.

• Engage with customers and customer facing teams to understand their perspective and bring it back to Engineering for improving the product

• What You’ll Bring: - 7+ years of experience building customer-facing products

• Skill in writing high-quality, maintainable code any programming language

• Demonstrated experience building an automation framework from scratch, with organized test categorization, reusability, and CI/CD integration.

• Strong understanding of software testing methodologies, test planning, and test strategy.

• Familiarity with using AI to enhance testing and software development.

• Strong problem-solving skills and attention to detail.

• Experience with Git, GitHub, CircleCI and cloud services like AWS/GCP

• Excellent communication, teamwork, and documentation skills, with a strong ability to advocate for best practices.

• Experience with testing modern web applications and Desktop applications based on Electron

• Preferred Skills: - Experience with defining a QA strategy and execution for a product that is now live

• Knowledge of test framework design and development.

• Strong understanding of test reporting tools and technologies.

• Experience with UI and API testing like Ginkgo and Playwright

• Experience with Performance and Stress testing

Nice to Have

• People management skills (Direct or Indirect)

• Experience building systems to validate AI systems including Agents

Join us in innovating our testing processes and ensuring the delivery of high-quality software products through advanced automation techniques.

DevRev is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

• Test Case Design and Documentation

• Actively use AI and intelligent agents to accelerate test generation, test maintenance, and coverage expansion.

• Leverage LLMs to convert requirements, user stories, and production incidents into high-quality automated test cases.

• Reduce reliance on manual test case creation by introducing AI-assisted automation workflows, with human review and ownership.

• Apply AI to optimize test selection, prioritization, and execution based on risk, code changes, and historical failures.

• Use AI to assist in identifying missing scenarios, edge cases, and negative paths from requirements and user behavior.

• Maintain strong traceability between product features, test cases, and automated coverage, with AI support for documentation updates and gap analysis.

Test Suite Development

• Create frameworks and standards that help AI create deterministic and stable tests

• Establish coding standards, branching strategies, and review guidelines for automation code.

• Integrate test execution into CI/CD pipelines with fast feedback loops and real-time reporting.

• Design and Build tools that help with test generation, flakiness detection, self-healing tests, and intelligent exploratory testing

• Champion shift-left testing by working closely with engineering, product, and DevOps teams to prevent defects early.

Quality Ownership and Continuous Improvement

• Own the health and evolution of the automation framework.

• Build AI systems that triage test failures, flaky behavior, and production escapes

• Continuously improve testing strategies based on learnings from releases, incidents, and customer impact.

• Promote a strong quality mindset where AI is used as a force multiplier, not a shortcut.

• Engage with customers and customer facing teams to understand their perspective and bring it back to Engineering for improving the product

• What You’ll Bring:

• 7+ years of experience building customer-facing products

• Skill in writing high-quality, maintainable code any programming language

• Demonstrated experience building an automation framework from scratch, with organized test categorization, reusability, and CI/CD integration.

• Strong understanding of software testing methodologies, test planning, and test strategy.

• Familiarity with using AI to enhance testing and software development.

• Strong problem-solving skills and attention to detail.

• Experience with Git, GitHub, CircleCI and cloud services like AWS/GCP

• Excellent communication, teamwork, and documentation skills, with a strong ability to advocate for best practices.

• Experience with testing modern web applications and Desktop applications based on Electron

- Experience with defining a QA strategy and execution for a product that is now live

• Knowledge of test framework design and development.

• Strong understanding of test reporting tools and technologies.

• Experience with UI and API testing like Ginkgo and Playwright

• Experience with Performance and Stress testing

Nice to Have**

• People management skills (Direct or Indirect)

• Experience building systems to validate AI systems including Agents

Join us in innovating our testing processes and ensuring the delivery of high-quality software products through advanced automation techniques.

DevRev is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.