Skip to content
Vellum & LoomSystems · Boulder, CO
Workbench / Source grounding
System notes / source grounding

Tracing every technical claim to its exact source

Attaching a bibliography link to the end of a long paragraph rarely tells a reviewer which statement is actually verified. Claim-level provenance binds each scoped factual assertion to the specific character span in an upstream document that supports it. When an engineering draft combines architecture rules, API limits, and release dates, editors can inspect the exact passage behind each individual statement.

Primary records outrank secondary summaries

Verification starts by selecting authoritative product documentation, original datasets, RFC documents with explicit approval states, and dated changelog entries over internal recaps. Every assertion links to a stable, versioned source anchor so editors can inspect the exact commit or release tag that existed when the draft was written. Transitive citations are rejected by policy because quoting a secondary summary hides whether the underlying specification actually supports the statement. When a source document has narrow scope or known quality limits, the pipeline preserves those boundaries in the claim record rather than smoothing them into broad assertions. Grounded drafting requires reading the primary record directly.

Statistical claims retain their denominators

Quantitative statements lose their meaning when a draft strips away sample size and collection context. In an illustrative benchmark dataset where 42 successful requests out of 50 observed attempts complete within budget, the pipeline records an 84 percent completion rate for that specific sample rather than a global reliability figure. Every numerical claim retains its denominator, collection date, test environment, and stated confidence limits as part of the provenance record. The drafting rules prohibit fabricated baselines and unsupported causal conclusions when comparing two measurements. Keeping these boundaries attached to the number prevents editors from turning a small illustrative run into a broad product promise.

Upstream revisions trigger targeted staleness checks

Technical documentation ages whenever an engineering team ships a breaking change or updates a configuration schema. Rather than issuing a generic warning across an entire article, the workbench computes a field-level diff against the updated source documentation. If an upstream commit removes a configuration parameter, alters request timeout units, or changes feature availability across deployment tiers, only the dependent claims tied to those specific anchors are marked stale. Reviewers inspect the exact old and new text spans side by side in the verification queue. This scoped audit trail lets editors update affected sentences quickly without re-verifying paragraphs whose underlying sources have not changed.

Citation metrics serve as editorial diagnostics

Coverage calculations divide the number of supported factual claims by the total factual claims and multiply by 100, while tracking distinct source anchors per 1000 words separately. Repeated references to the same passage do not count as extra evidence, and passages containing no factual claims return a not applicable status instead of an artificial score. High citation density is a structural diagnostic, not a guarantee of truth. Deterministic mechanical checks can confirm that an anchor resolves, that a version identifier matches, and that a quoted span exists, whereas judging whether a passage genuinely supports a nuanced technical claim remains a fallible semantic review.

Human editors govern the publication ledger

When a claim lacks an accessible primary source, the workbench marks it unresolved rather than verified. Conflicting upstream documents route the passage to a subject-matter expert, and any editorial override records a written rationale alongside the author identity. Exported drafts retain their complete source ledger for auditability, though editors must still filter the ledger before release because not all internal engineering documents are safe to publish externally.

Illustrative evidence audit · sample A
Unbounded claimSource-grounded revision
Production reliability is 84%.42 of 50 requests succeeded in this test sample.