Skip to content

docs: sync remaining 82 hand-written docs with actual implementation (audit pass 2) - #1904

Merged
os-zhuang merged 1 commit into
mainfrom
docs/audit-handwritten-remaining
Jun 15, 2026
Merged

docs: sync remaining 82 hand-written docs with actual implementation (audit pass 2)#1904
os-zhuang merged 1 commit into
mainfrom
docs/audit-handwritten-remaining

Conversation

@os-zhuang

Copy link
Copy Markdown
Contributor

Finishes the implementation-accuracy audit started in #1866 (which covered 46 docs in getting-started/concepts/guides). This pass covers the remaining 82 hand-written docs — guides (incl. cheatsheets/contracts/metadata/runtime-services), protocol (objectos/objectql/objectui), releases, and the docs index.

What this does

A multi-agent audit read each doc, located the real implementation in packages/, and adversarially verified every finding against the code — a second verifier re-checked each applied fix and repaired over-corrections.

MetricCount
Docs processed82 / 82
Docs changed73
Fixes applied486
Verifier repairs (caught over-corrections)28
Residual items flagged for follow-up210

Recurring classes of fix

  • broken-example / inaccurate-api — methods/samples that don't exist or changed: fabricated transaction methods (tx.insert/tx.update), non-existent helpers (definePlugin), wrong package names (@objectstack/services/service-cache@objectstack/service-cache), ViewFieldSchemaFormFieldSchema, wrong @objectstack/spec subpath imports.
  • fabricated-feature — field-type props absent from the schema (sanitize/allowed_tags/protocols/region/rows), a phantom Workflow metadata type with *.workflow.ts conventions, fabricated CLI scaffold output.
  • naming/enum driftmax_lengthmaxLength; relationship/complex type lists corrected to real enum values; OWDModel value spellings (public_read/…).
  • security model — FLS non-editable write rejects with PermissionDeniedError (403) rather than silent strip; real PermissionSet over Salesforce-style shapes.
  • outdated paths/envOS_EMAIL__PROVIDER double-underscore, /v1 REST prefixes, config-resolution precedence and envKey coercion examples.

Verification

  • Navigation-safe: no files moved, frontmatter preserved on every doc.
  • next build compiles all 1113 pages clean (exit 0).
  • Diff is scoped to hand-written docs only — zero references/, zero code touched.

Follow-ups (out of scope here)

Residual items the audit could not confirm against code — plus the observation that committed content/docs/references/ have drifted from spec (16 files regenerate with diffs; 3 newly-added spec types missing entirely) — are recorded in docs/audits/2026-06-handwritten-docs-accuracy-followups.md for a dedicated regenerate-references pass.

🤖 Generated with Claude Code

…(audit pass 2)
Finishes the implementation-accuracy audit started in #1866 (which covered 46
docs in getting-started/concepts/guides). This pass covers the remaining 82
hand-written docs — guides (incl. cheatsheets/contracts/metadata/runtime-services),
protocol (objectos/objectql/objectui), releases, and the docs index.
A multi-agent audit read each doc, located the real implementation in packages/,
and adversarially verified every finding against the code (a second verifier
re-checked each applied fix and repaired over-corrections). This applies 486
verified fixes across 73 docs, plus 28 verifier repairs. Auto-generated
references/ docs (DO-NOT-EDIT, produced from packages/spec) were excluded.
Recurring classes of fix:
- broken-example / inaccurate-api: code samples and method names that don't
exist or changed — fabricated transaction methods (tx.insert/tx.update),
non-existent helpers (definePlugin), wrong package names
(@objectstack/services/service-cache -> @objectstack/service-cache),
ViewFieldSchema -> FormFieldSchema, wrong @objectstack/spec subpath imports.
- fabricated-feature: field-type props that aren't in the schema
(sanitize/allowed_tags/protocols/region/rows), a phantom `Workflow` metadata
type with *.workflow.ts conventions, fabricated CLI scaffold output.
- naming/enum drift: max_length -> maxLength; relationship/complex type lists
corrected to real enum values; OWDModel value spellings (public_read/...).
- security model: FLS non-editable write rejects with PermissionDeniedError
(403) rather than silent strip; PermissionSet over Salesforce-style shapes.
- outdated paths/env: OS_EMAIL__PROVIDER double-underscore, /v1 REST prefixes,
config-resolution precedence and envKey coercion examples.
Navigation-safe: no files moved, frontmatter preserved on every doc.
Verified: `next build` compiles all 1113 pages clean (exit 0).
Residual items the audit could not confirm against code, plus the observation
that committed references/ have drifted from spec, are recorded in
docs/audits/2026-06-handwritten-docs-accuracy-followups.md for a follow-up pass.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@vercel

vercelBot commented Jun 15, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
specReadyReadyPreview, CommentJun 15, 2026 9:12am

Request Review

@github-actionsgithub-actionsBot added documentation Improvements or additions to documentation size/xl labels Jun 15, 2026
@os-zhuang
os-zhuang merged commit c77ac65 into mainJun 15, 2026
13 checks passed
@os-zhuang
os-zhuang deleted the docs/audit-handwritten-remaining branch June 15, 2026 09:15
os-zhuang added a commit that referenced this pull request Jun 15, 2026
…ation (#1906)
* chore(docs): tooling to keep hand-written docs in sync with implementation
Stands up recurring implementation-accuracy verification for the 128 hand-written
docs as the platform evolves, layered cheapest-and-earliest first:
1. scripts/docs-audit/affected-docs.mjs — maps packages/** changes to the
hand-written docs that reference the affected packages (by npm name / repo
path), so an audit can be scoped to what actually changed instead of
re-auditing everything. Supports --all and --json.
2. .github/workflows/docs-drift-check.yml — advisory CI gate: on PRs touching
packages/**, posts a sticky PR comment listing the docs that reference the
changed code. Flags drift at the source; never fails the build.
3. .claude/workflows/docs-accuracy-audit.js — the reusable multi-agent audit
(audit + adversarial verifier per doc), parameterized by args.docs; defaults
to all hand-written docs. Same pipeline that produced #1866 and #1904.
4. scripts/docs-audit/README.md — how the four parts fit together, including the
scheduled-routine backstop.
References (content/docs/references/, generated from packages/spec) are out of
scope and handled by a separate regenerate pass.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* chore: add no-release changeset for docs-drift tooling
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentationImprovements or additions to documentationsize/xl

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@os-zhuang