Accessibility
Benchmark fixtures with intentionally seeded WCAG violations, decoy traps and manual-only barriers. Each variant also serves its ground-truth oracle at its `.json` representation.
-
Checkout form (mixed)
Flagship fixture: labels, contrast, images, structure and keyboard barriers seeded together, plus traps.
-
Color contrast
Text and controls at a spectrum of contrast ratios — real failures next to large-text and disabled-control traps.
-
ARIA widgets
Custom tabs, menu, dialog and switch with wrong or missing roles/names, next to a correctly built widget.
-
Structure & media
Headings, landmarks, lists, tables, images and SVG with structural and text-alternative defects.
-
WCAG scope & no-merge
One page failing several Success Criteria (three distinct 1.3.3 sensory failures, plus 1.1.1 and 1.4.1). When a run is scoped to one SC, off-SC findings are traps, and the distinct 1.3.3 failures must stay separate bugs.
-
Many affected elements
A large form where ten inputs miss labels under the same rule — one grouped violation that must enumerate ALL affected elements — plus correctly-labelled traps.
-
Clean (false-positive floor)
A fully accessible page with ZERO seeded defects — anything reported here is a false positive.
-
Keyboard & focus
Removed and invisible focus rings, focus thrown off links, tabindex=-1 actions, focusable-but-inert widgets, a hover-only menu and a focus order that contradicts the layout.
-
Dynamic content
Auto-advancing carousel, marquee, autoplaying audio, a silent status update, a pointer-only tooltip and a session that expires without warning — next to compliant counterparts.
-
Document structure
Placeholder page title, zoom disabled, no landmarks or real headings, fake lists, reading order that contradicts the layout, an untitled frame and invalid ARIA.
-
Images & links
Text alternatives that exist but are wrong — empty on an informative chart, contradicting the image, a file name, decorative noise — plus nameless image links and icon names.
-
Targets & states
Undersized pointer targets and text that fails contrast only in a state — hover, focus, placeholder or over a gradient — next to near-threshold samples that pass.
-
Clean interactive (false-positive floor)
Disclosure, pausable rotator, compliant tooltip, live status, native modal dialog and spaced targets — all correct. Anything reported here is a false positive.
-
Mission — book an appointment
Choose a clinic, pick a slot, enter details, book. The slot picker traps keyboard focus and its confirm action is click-only.
-
Mission — pay an invoice
Find the urgent invoice, choose a card, enter payer details, pay. Urgency is colour-only and the payment-method select cannot be opened by keyboard.
-
Mission — checkout
Basket, delivery overlay, address & payment, review. The overlay ignores focus, a select changes context and the terms checkbox is click-only.
-
Mission — university application
Read the guidelines, fill in the form, pass the CAPTCHA, submit. The guidelines modal cannot be closed by keyboard and the CAPTCHA has no alternative.
-
Mission — reserve a seat (false-positive floor)
A correctly built multi-step reservation with a native modal dialog and accessible errors. Completable by keyboard; anything reported is a false positive.