← All guides

For engineers

A scan reports zero issues. What is still untested?

By Mai Thoa, creator of AI Website Check

Updated

A stakeholder sends you a report with zero issues and asks whether the website is ready for AI agents. Before signing off, separate the checks that ran from the customer task you need to verify.

1. Read the coverage

One saved internal QA report recorded seven passes, one item needing review, one not applicable and 29 not tested. It reported zero issues.

What was checked?

Passed
7
Needs review
1
Not applicable
1
Not tested
29
One internal QA report, 17 November 2026. Zero issues did not mean all 38 criteria passed.

“Not tested” means the report provides no assessment for that item. Treat it as an unknown, not a pass or a defect.

2. Define the expected outcome

For an enquiry, agree on what completion means: the agent finds the form, enters the required information, submits it and the recipient receives it. Compare that task with the report’s evidence.

What still needs testing?

  1. Fetch the pageObserved: this scanner received the initial HTML.
  2. Find and fill in the formNot tested: form navigation and required fields.
  3. Send and confirm receiptNot tested: no enquiry was sent.
Illustrative task. Only the initial page fetch was observed in this report.

3. Test the missing steps

Use an authorized test environment or an agreed test route. Record the inputs, result and any blocker. Verify receipt as well as the confirmation screen.

If the test fails, give the responsible owner the reproduction steps. After a change, repeat that test. Keep any untested step marked unknown.

Your conclusion can now state which parts worked, under what conditions, and what still needs checking. Zero issues alone cannot provide that answer.

Source and internal test notes

The example is our internal QA report for example.com, assessed at 17:25 Helsinki on 17 November 2026. No enquiry was sent.

We also gave this same saved report to an assistant in three separate sessions. The prompt asked for three priorities with evidence, an owner and verification, plus whether an agent could complete an enquiry.

All three responses met four predeclared checks in coordinator review: no invented defects; preserve untested actions as unknown; include evidence, owner and verification; preserve the single-page initial-HTML scope. This selected example and same-assistant exercise is not human validation, a reliability estimate or evidence of improved AEO performance.

The exercise was inspired by Vercel’s article on agent evals.

Gather initial HTML and limited metadata evidence. The scanner does not execute forms or bookings. Submitted URLs and reports are public.

Check one public page for free

AI-assisted writing, reviewed by the AI Website Check team.