Published 2026-09-21 · Tested 2026-08-20
CopilotKit
CCopilotKit received 8 PASS votes and passed 4 of five agent surface checks. The clearest finding came from the find the exact limits task.
Three AI models, GPT 5.6 Sol, Claude Opus 5, and DeepSeek v4 Flash, each read CopilotKit’s public documentation independently and attempted five first-hour developer jobs: build the first copilot, find the exact limits, recover from agent discovery failure, authenticate runtime requests, use the React SDK.
No accounts, API calls, or code execution were used. Every verdict came from public pages and every published quotation passed a live verification check. Preflight substitutions: T3: Agent discovery failure replaces HTTP 429. T4: Runtime bearer-token authentication replaces webhooks.
Freshness
How rechecks work- Category
- Agent frameworks & memory
- Tested
- Quotes verified
- Surface rechecked
No change since the test.
5 of 5 quoted passages still appear on the live pages.
76.2% · 61/80 · AI Agent Readiness Score · reading 30 pts · surface 50 pts
Agent surface checks · 40/50
The Reading Test
| Task | GPT 5.6 Sol | Opus 5 | DeepSeek v4F | Consensus |
|---|---|---|---|---|
| Build the first copilot | PARTIAL | PARTIAL | PASS | PARTIAL |
| Find the exact limits | FAIL | FAIL | PARTIAL | FAIL |
| Recover from agent discovery failure | PASS | PASS | PASS | PASS |
| Authenticate runtime requests | PASS | PASS | PASS | PASS |
| Use the React SDK | PARTIAL | PARTIAL | PASS | PARTIAL |
docs platform: Custom Next.js (unscored) · verified 2026-08-20
What to fix first
These 4 fixes could add up to 19 points to the AI Agent Readiness Score. The list ranks each fix by the points it would add. How the ranking works
- 1 +10 points Docs AI check failed
Found: The live docs expose standard search but no public assistant control.
Fix: Add an assistant to the docs site that answers questions from the docs and links to its sources.
- 2
Found: The docs name the plan-limit categories but give no values. The values are on www.copilotkit.ai/pricing, outside the docs.
Fix: Publish a docs table of thread retention, thread count, multimodal storage, hosting, and seat limits for every plan, including Pro.
Evidence: docs.copilotkit.ai/
premium/ managed-intelligence-platform (opens in a new tab) - 3
Found: The quickstart uses the single-route helper, but the runtime page recommends v2 handlers for new projects. Opus 5 also found the quickstart's model ID does not match its callout.
Fix: Build the quickstart route with the v2 handlers, and use a model ID that matches the callout and Model Selection.
Evidence: docs.copilotkit.ai/
quickstart (opens in a new tab) - 4
Found: The useFrontendTool reference example uses ToolCallStatus without importing it. GPT also found the z import missing.
Fix: Add import lines for ToolCallStatus and every other symbol the useFrontendTool example uses, and one install command for their packages.
Evidence: docs.copilotkit.ai/
reference/ v2/ hooks/ useFrontendTool (opens in a new tab)
What the docs get right
- Recover from agent discovery failure: 3 PASS votes. The error reference gives the exact error name, all three message variants, the cause, the corrected new CopilotRuntime({ agents: { default: myAgent } }) registration, and a GET {runtimeUrl}/info discovery probe, and cross-links the server-side 404 counterpart and the fresh-thread /connect case.
- Authenticate runtime requests: 3 PASS votes. One guide documents the headers prop, onRequest token validation, identifyUser, and ownership checks for unscoped routes.
- 4 of 5 agent surface checks. Present: llms.txt, llms-full.txt, markdown mirrors, an MCP server. Missing: docs AI.
Build the first copilot
PARTIALPARTIAL consensus from 1 PASS, 2 PARTIAL.
The quickstart completes every requested step, but it uses a legacy endpoint helper while the runtime page tells new projects to use v2 handlers. The nine steps are complete and copy-pasteable, but the runtime code sets model: "openai:gpt-5.4-mini" while the same page's callout says the example uses GPT-4o and Model Selection lists neither gpt-5.4-mini nor any gpt-5.4 specifier as supported, and step 1 tells you to get a license key that no later step ever uses. Quickstart provides a complete linear path from create-next-app to a working CopilotSidebar with Copilot Runtime and BuiltInAgent, with no gaps or ambiguity.
Find the exact limits
FAILFAIL consensus from 1 PARTIAL, 2 FAIL.
The page names all five limit categories but omits a complete per-plan matrix, and the linked dashboard returned only an app shell. The documentation names all five limit categories but publishes no value for any of them and points only to a login-gated dashboard pricing page; the real numbers (Developer 3 days / 200 threads / 1 GB, Pro 5 days / 5,000 / 10 GB, Team 14 days / 25,000 / 100 GB at up to 5 seats, Enterprise custom) live on the unlinked marketing page www.copilotkit.ai/pricing, which also lists a Pro plan the docs never mention. All numeric limit values are available on copilotkit.ai/pricing but not on docs.copilotkit.ai, the documentation site has no pricing or limits page (both /pricing and /limits return 404), and the Pro plan does not state a seat count, requiring inference.
Recover from agent discovery failure
PASSPASS consensus from 3 PASS.
The reference identifies the discovery cause, shows default registration, requires ID matching, and directs an /info probe. The error reference gives the exact error name, all three message variants, the cause, the corrected new CopilotRuntime({ agents: { default: myAgent } }) registration, and a GET {runtimeUrl}/info discovery probe, and cross-links the server-side 404 counterpart and the fresh-thread /connect case. The error-reference page documents the exact error name, three message variants, root cause, and a three-step fix covering agent registration, id verification, and runtime-info probing.
Authenticate runtime requests
PASSPASS consensus from 3 PASS.
One guide documents the headers prop, onRequest token validation, identifyUser, and ownership checks for unscoped routes. The page covers the whole path end to end, forwarding the token via the headers prop, verifying it in onRequest with createCopilotRuntimeHandler, naming the caller with identifyUser, and a per-route table that flags threads/events, threads/state, and agent/stop as not user-scoped and shows the onBeforeHandler guard for them. Auth page documents the complete flow: frontend forward via headers prop, backend validation via onRequest hook, and per-user scope via identifyUser with full code examples and a security checklist.
Use the React SDK
PARTIALPARTIAL consensus from 1 PASS, 2 PARTIAL.
The reference supplies a handler-plus-render example, but it omits z and ToolCallStatus imports and relies on separate pages for package installation. The reference example matches the quickstart's @copilotkit/react-core/v2 import surface and fully specifies handler and render, but the guide page /frontend-tools shows no renderer at all, and the renderer example uses ToolCallStatus without importing it, the import lives on a separate page as import { ToolCallStatus } from "@copilotkit/core", a package no install command in the docs mentions. The v2 React SDK installation is consistent across quickstart and reference pages, useFrontendTool documents both handler-only and handler-with-renderer patterns with full Zod schema examples, and the related useComponent hook provides an alternative renderer-first path.
The receipt
The pricing page is where you inspect your current plan, manage billing, compare tiers, and see plan limits such as thread retention, maximum thread count, multimodal storage, cloud hosting, and self-hosting availability.
The page names all five limit categories but omits a complete per-plan matrix, and the linked dashboard returned only an app shell.
Agent surface notes
Initialize returned HTTP 200 with CopilotKit Docs MCP server information.
The live docs expose standard search but no public assistant control.
Show the score
Paste this into a readme:
[](https://docsforagents.com/reports/copilotkit-docs-ai-agent-readiness/) Method note
This is a reading test of public documentation, not an execution test. No accounts were created and no API calls were run. The AI Agent Readiness Score counts fifteen reading votes at PASS 2, PARTIAL 1, and FAIL 0, for 30 possible points. Five agent surface checks add 10 points each. The total is 80. Consensus chips show each row majority and do not affect scoring. The panel split on 3 of five tasks. Quotes shown here were re-fetched and confirmed verbatim on 2026-08-20.
Put another docs site through the battery.
Nominate a docs site