Readiness · Task evidence
What did the agent do?
These records show read-only browser tasks on the owned Readiness site and on four local test pages. Read the steps, outcome, time, and cost of each run. Task results are separate from the static readiness score.
One owned site, three fixed tasks, two runs per task. No independent or general agent-success benchmark. No model weight was changed from these results.
6 published runs · model 27 · capture profile 28 · revision cd4e33b
Read the source audit · Download the task records
Does a documentation check predict task success?
Four owned local fixture pages; one fixed read-only task, repeated twice per case.
Predict documentation task success only when public-api-docs is pass.
4 test cases · 8 browser runs · model 27
- Pass prediction; task passed
- 2
- Pass prediction; task failed
- 2
- Failure prediction; task passed
- 2
- Failure prediction; task failed
- 2
A documentation link can open an empty page. A working button can have no source anchor. These cases show why a link check cannot guarantee that a task will pass.
These purpose-built controls test a task proxy, not the truth of the narrower link check or the accuracy of the full score. They are not a random or independent site sample.
Keep model 27 unchanged. A source link can exist without usable documentation, and a native button can work without a source anchor. A link check must not be presented as a task-success guarantee. This small control set does not justify new score weights.
Download the checks, page source, and task records
Working documentation link · succeeded · true pass
Task: Find documentation for GET /api/v1/widgets and its response format.
Expected outcome: succeeded
Observed: The required GET operation and response format are present.
2.35 seconds of browser execution · 2026-09-30T19:51:42 UTC
public-api-docs: pass. The page links to 1 API or documentation target(s).
-
Open the owned fixture
linked-good.html1151 ms -
Follow the named documentation control
docs.html783 ms
Task runner paid API cost: $0.00
Total cost: not measured. Total task cost is not measured. The local browser runner makes no paid model or browser API call. Codex planning and hosting are outside this measure.
Link to an empty page · failed · false pass
Task: Find documentation for GET /api/v1/widgets and its response format.
Expected outcome: failed
Observed: The page is readable, but the required operation and response format are absent.
2.25 seconds of browser execution · 2026-09-30T19:51:44 UTC
public-api-docs: pass. The page links to 1 API or documentation target(s).
-
Open the owned fixture
linked-placeholder.html1094 ms -
Follow the named documentation control
placeholder.html748 ms
Task runner paid API cost: $0.00
Total cost: not measured. Total task cost is not measured. The local browser runner makes no paid model or browser API call. Codex planning and hosting are outside this measure.
No documentation control · failed · true failure
Task: Find documentation for GET /api/v1/widgets and its response format.
Expected outcome: failed
Observed: No documentation link or control is available.
1.61 seconds of browser execution · 2026-09-30T19:51:50 UTC
public-api-docs: warning. The page mentions an API, but no API documentation link was classified.
-
Open the owned fixture
no-docs.html1000 ms
Task runner paid API cost: $0.00
Total cost: not measured. Total task cost is not measured. The local browser runner makes no paid model or browser API call. Codex planning and hosting are outside this measure.
Working documentation link · succeeded · true pass
Task: Find documentation for GET /api/v1/widgets and its response format.
Expected outcome: succeeded
Observed: The required GET operation and response format are present.
2.22 seconds of browser execution · 2026-09-30T19:51:52 UTC
public-api-docs: pass. The page links to 1 API or documentation target(s).
-
Open the owned fixture
linked-good.html985 ms -
Follow the named documentation control
docs.html831 ms
Task runner paid API cost: $0.00
Total cost: not measured. Total task cost is not measured. The local browser runner makes no paid model or browser API call. Codex planning and hosting are outside this measure.
Link to an empty page · failed · false pass
Task: Find documentation for GET /api/v1/widgets and its response format.
Expected outcome: failed
Observed: The page is readable, but the required operation and response format are absent.
2.24 seconds of browser execution · 2026-09-30T19:51:54 UTC
public-api-docs: pass. The page links to 1 API or documentation target(s).
-
Open the owned fixture
linked-placeholder.html1104 ms -
Follow the named documentation control
placeholder.html725 ms
Task runner paid API cost: $0.00
Total cost: not measured. Total task cost is not measured. The local browser runner makes no paid model or browser API call. Codex planning and hosting are outside this measure.
No documentation control · failed · true failure
Task: Find documentation for GET /api/v1/widgets and its response format.
Expected outcome: failed
Observed: No documentation link or control is available.
1.62 seconds of browser execution · 2026-09-30T19:51:59 UTC
public-api-docs: warning. The page mentions an API, but no API documentation link was classified.
-
Open the owned fixture
no-docs.html1003 ms
Task runner paid API cost: $0.00
Total cost: not measured. Total task cost is not measured. The local browser runner makes no paid model or browser API call. Codex planning and hosting are outside this measure.
Tasks on the live Readiness site
The linked-content pass agrees with the documentation and policy reads in this owned sample. The trust-page warning means some page categories are absent; it does not mean a privacy task must fail. A control-name warning also does not prove a task cannot finish. The core score is not a task-success prediction.
This live set has one site and three tasks, each repeated twice. All six tasks pass. The local controls above include task failures. Neither set is an independent sample of sites. The model weights remain unchanged. A larger study needs consented sites and a separate test set.
Find the API documentation
Succeeded · 2.14 seconds of browser execution · 2026-09-30T19:03:46 UTC
Expected: Find readable API documentation and its scan command contract without sign-in.
Observed: The API page links to a readable OpenAPI contract. Starting a scan requires a bearer token; public reads need no token.
View 3 recorded steps
- Open the public home page https://readiness.sh/ 613 ms
- Follow the API link https://readiness.sh/docs 665 ms
- Read the linked OpenAPI contract https://readiness.sh/api/v1/openapi.json 652 ms
Task runner paid API cost: not measured
Total cost: not measured. Provider cost was not measured. Browser time excludes Codex planning and review.
Codex-directed Chromium; fixed navigation, no sign-in or form writes
Explain the product and score limits
Succeeded · 3.15 seconds of browser execution · 2026-09-30T19:03:49 UTC
Expected: Find the product purpose and the conditions for a numeric readiness score.
Observed: Readiness audits public content and interfaces. Model 27 needs a readable main page and 80% core coverage. It does not promise general task success.
View 3 recorded steps
- Open the public home page https://readiness.sh/ 1458 ms
- Follow the About link https://readiness.sh/about 634 ms
- Read the score method https://readiness.sh/methodology 650 ms
Task runner paid API cost: not measured
Total cost: not measured. Provider cost was not measured. Browser time excludes Codex planning and review.
Codex-directed Chromium; fixed navigation, no sign-in or form writes
Find the report policy and removal path
Succeeded · 3.0 seconds of browser execution · 2026-09-30T19:03:52 UTC
Expected: Find the public report policy and a path to request removal.
Observed: Pending reports are readable by direct URL and are not private. Hidden reports return 404. The Contact page accepts removal requests after sign-in while challenge keys are absent.
View 3 recorded steps
- Open the public home page https://readiness.sh/ 1329 ms
- Follow the Privacy link https://readiness.sh/privacy 631 ms
- Follow the Contact link https://readiness.sh/contact 634 ms
Task runner paid API cost: not measured
Total cost: not measured. Provider cost was not measured. Browser time excludes Codex planning and review.
Codex-directed Chromium; fixed navigation, no sign-in or form writes
Find the API documentation
Succeeded · 2.85 seconds of browser execution · 2026-09-30T19:03:56 UTC
Expected: Find readable API documentation and its scan command contract without sign-in.
Observed: The API page links to a readable OpenAPI contract. Starting a scan requires a bearer token; public reads need no token.
View 3 recorded steps
- Open the public home page https://readiness.sh/ 1340 ms
- Follow the API link https://readiness.sh/docs 668 ms
- Read the linked OpenAPI contract https://readiness.sh/api/v1/openapi.json 636 ms
Task runner paid API cost: not measured
Total cost: not measured. Provider cost was not measured. Browser time excludes Codex planning and review.
Codex-directed Chromium; fixed navigation, no sign-in or form writes
Explain the product and score limits
Succeeded · 3.08 seconds of browser execution · 2026-09-30T19:03:59 UTC
Expected: Find the product purpose and the conditions for a numeric readiness score.
Observed: Readiness audits public content and interfaces. Model 27 needs a readable main page and 80% core coverage. It does not promise general task success.
View 3 recorded steps
- Open the public home page https://readiness.sh/ 1382 ms
- Follow the About link https://readiness.sh/about 640 ms
- Read the score method https://readiness.sh/methodology 641 ms
Task runner paid API cost: not measured
Total cost: not measured. Provider cost was not measured. Browser time excludes Codex planning and review.
Codex-directed Chromium; fixed navigation, no sign-in or form writes
Find the report policy and removal path
Succeeded · 3.08 seconds of browser execution · 2026-09-30T19:04:02 UTC
Expected: Find the public report policy and a path to request removal.
Observed: Pending reports are readable by direct URL and are not private. Hidden reports return 404. The Contact page accepts removal requests after sign-in while challenge keys are absent.
View 3 recorded steps
- Open the public home page https://readiness.sh/ 1413 ms
- Follow the Privacy link https://readiness.sh/privacy 630 ms
- Follow the Contact link https://readiness.sh/contact 627 ms
Task runner paid API cost: not measured
Total cost: not measured. Provider cost was not measured. Browser time excludes Codex planning and review.
Codex-directed Chromium; fixed navigation, no sign-in or form writes