Skip to content

Instantly share code, notes, and snippets.

@mfaisalkhatri
Last active April 24, 2026 14:43
Show Gist options
  • Select an option

  • Save mfaisalkhatri/e8c49f43ee0cc7787700b1a56348c22c to your computer and use it in GitHub Desktop.

Select an option

Save mfaisalkhatri/e8c49f43ee0cc7787700b1a56348c22c to your computer and use it in GitHub Desktop.
Comparision between Playwright Codegen and AI
Criteria Playwright Codegen Playwright with AI (Playwright MCP with Claude or GitHub Copilot)
How it works Records user interactions and generates scripts based on browser actions. It can also automatically generate toBeVisible() assertions. Generates and executes tests based on natural language prompts.
Input Method Manual interaction with the browser (click, type, navigate). Instructions are provided in plain English text describing the test scenario.
Understanding Context Does not understand business logic, only records actions. It can understand context, business rules, and expected outcomes from prompts.
Speed of Test Script Creation The automation scripts are automatically generated after the user interacts with the website. As soon as the user inputs the prompt, the test scripts and execution begin.
Exploratory Testing Not suitable for exploratory testing as it records actions performed by the user. Exploratory testing involves thinking, observing behaviour, and validating outcomes. Codegen does not automatically add validations and needs manual enhancements. Supports vibe testing, exploratory scenarios, and UX-focused validation.
Dependency on Human Actions Requires manual interaction during recording. Fully prompt-driven. No manual browser interaction is required.
Flexibility Limited to recorded steps. Requires manual refactoring for improvements. Can generate optimized and reusable code directly.
Maintenance Scripts often require cleanup and restructuring after recording. Can regenerate or refactor scripts quickly based on updated prompts.
Use Case Best for quick prototyping or basic UI automation. Ideal for intelligent automation, test generation, and UX validation.
Learning Curve Easy for beginners to start recording tests. Requires skill in writing clear and concise prompts.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment