World-State docs
World-State is the safe memory layer behind MCP video tools.
MCP tools are only useful when the resources are structured and trustworthy. World-State turns video into durable artifacts that agents can read, cite, and audit.
Artifact family for MCP agents
| Artifact | MCP resource role | Required agent behavior |
|---|---|---|
| scene_graph.json | State resource | Cite evidence refs for object/event claims |
| timeline.json | Temporal resource | Avoid causal claims without support |
| evidence_bundle.json | Grounding resource | Every answer references spans |
| detector_report.json | Uncertainty resource | Expose fallback and low confidence |
| cost.json | Budget resource | Show cost context for repeated queries |
Agent output contract
{{
"answer": "A delivery vehicle entered the loading zone at 00:01:14.",
"evidence_refs": ["ev_loading_zone_00114"],
"artifact_versions": {{"scene_graph": "2026-06-24", "timeline": "2026-06-24"}},
"confidence": "medium",
"review_required": true,
"blocked_actions": ["identity", "intent", "physical_action"],
"cost_context_ref": "cost_20260624_001"
}}Implementation checklist
- Use tenant-scoped artifact URIs.
- Pass artifact version into agent traces.
- Require evidence_ref citations for factual answers.
- Map low confidence to review_required.
- Block identity, intent, emergency, and physical-action claims by default.
- Record tool calls and cost context in an audit trail.
The purpose of this page is to make the MCP boundary concrete for builders, buyers, and reviewers. A useful MCP integration is not a promise that an agent can watch everything and decide everything. It is a disciplined interface over already-materialized evidence. Each tool call should be tenant-scoped, read-only by default, evidence-aware, cost-aware, and auditable. If the request asks for identity, intent, physical access, emergency response, employment action, or destructive change, the tool returns a review-required state instead of pretending that a video artifact is a final decision. This keeps the product useful for developers while making it credible for security, legal, and operations teams.