Playwright visual testing is free and built in. So why do companies pay for Applitools, Percy, or Chromatic? Because pixel comparison has limits. Third-party tools use AI to detect "meaningful" visual changes while ignoring noise. Let us compare.
| Feature | Playwright | Applitools | Percy | Chromatic |
|---|---|---|---|---|
| Cost | Free | Paid (free tier) | Paid (free tier) | Paid (free tier) |
| Comparison method | Pixel diff | AI Visual | DOM snapshot | Pixel + anti-flake |
| Cross-browser | Local only | Cloud grid | Cloud rendering | Cloud rendering |
| Dashboard | None | Yes (web) | Yes (web) | Yes (web) |
| False positives | High without tuning | Very low (AI) | Low | Low |
| Setup effort | Zero (built-in) | SDK install + API key | SDK install + token | Storybook setup |
| Best for | Small-medium projects | Enterprise apps | CI-heavy teams | Design systems |
import { test } from '@playwright/test';
import {
BatchInfo,
Configuration,
Eyes,
Target,
} from '@applitools/eyes-playwright';
let eyes: Eyes;
test.beforeEach(async ({ page }) => {
eyes = new Eyes();
const config = new Configuration();
config.setBatch(new BatchInfo('Banking Portal'));
config.setApiKey(process.env.APPLITOOLS_API_KEY!);
eyes.setConfiguration(config);
await eyes.open(page, 'Banking App', test.info().title);
});
test.afterEach(async () => {
await eyes.close();
});
test('login page -- Applitools', async ({ page }) => {
await page.goto('/banking/login');
await eyes.check('Login Page', Target.window().fully());
});Q: Have you used any visual testing tools? How do they compare to Playwright built-in visual testing?
A: Playwright toHaveScreenshot() is pixel-based and free. It works well for small projects but needs tuning to avoid false positives from font rendering and anti-aliasing. Tools like Applitools use AI to detect meaningful changes while ignoring noise, so false positives are much lower. Percy sends DOM snapshots and renders them on their servers, giving consistent cross-browser results. For my current project, Playwright built-in is sufficient. For a large enterprise app with many pages and a design team that needs a review dashboard, I would recommend Applitools or Percy.
Key Point: Playwright visual testing is free and good for most projects. Third-party tools add AI comparison, cloud dashboards, and cross-browser rendering for enterprise needs.
Key Point: Playwright built-in is free and sufficient for most projects. Applitools, Percy, and Chromatic add AI comparison, dashboards, and cross-browser rendering at a cost.