Published 2026-09-22 · Tested 2026-09-22
Mastra
B-Mastra received 11 PASS votes and passed 4 of five agent surface checks. The clearest finding came from the find the exact limits task.
Three AI models, GPT 5.6 Sol, Claude Opus 5, and DeepSeek v4 Flash, each read Mastra’s public documentation independently and attempted five first-hour developer jobs: build the first agent, find the exact limits, recover from a failed step, authenticate the server, use the TypeScript SDK.
No accounts, API calls, or code execution were used. Every verdict came from public pages and every published quotation passed a live verification check. Preflight substitutions: T3: A documented workflow step failure replaces HTTP 429 because Mastra states that its rate limits are not published contracts. T4: JWT authentication of a deployed Mastra server replaces webhooks because Mastra documents receiving external webhooks but exposes no product webhook to create and verify.
Freshness
How rechecks work- Category
- Agent frameworks & memory
- Tested
- Quotes verified
- Surface rechecked
- Not yet rechecked
80.0% · 64/80 · AI Agent Readiness Score · reading 30 pts · surface 50 pts
Agent surface checks · 40/50
The Reading Test
| Task | GPT 5.6 Sol | Opus 5 | DeepSeek v4F | Consensus |
|---|---|---|---|---|
| Build the first agent | PASS | PASS | PASS | PASS |
| Find the exact limits | FAIL | PARTIAL | FAIL | FAIL |
| Recover from a failed step | PASS | PASS | PASS | PASS |
| Authenticate the server | PASS | PARTIAL | PASS | PASS |
| Use the TypeScript SDK | PASS | PASS | PASS | PASS |
docs platform: Docusaurus (unscored) · verified 2026-09-22
What to fix first
These 2 fixes could add up to 15 points to the AI Agent Readiness Score. The list ranks each fix by the points it would add. How the ranking works
- 1 +10 points llms-full.txt check failed
Found: HTTP 404 returning the site HTML shell, and /docs/llms-full.txt also returns 404.
Fix: Publish llms-full.txt at the docs root with the full text of every docs page in one plain-text file.
- 2
Found: The platform API page says rate limits are not published contracts, and the environments page ties the environment count to the plan without giving a number.
Fix: State the platform request rate limit on the API page, and list the number of environments each plan allows on the environments page.
Evidence: mastra.ai/
docs/ mastra-platform/ api (opens in a new tab)
What the docs get right
- Build the first agent: 3 PASS votes. The guessed create-project URL returned 404, but the docs root, agent page, model page, and develop page still provide one complete path.
- Recover from a failed step: 3 PASS votes. The error-handling page shows a failed fetch, step and workflow retries, result inspection, and onError handling.
- 4 of 5 agent surface checks. Present: llms.txt, markdown mirrors, an MCP server, docs AI. Missing: llms-full.txt.
Build the first agent
PASSPASS consensus from 3 PASS.
The guessed create-project URL returned 404, but the docs root, agent page, model page, and develop page still provide one complete path. Get started gives a condensed agent-targeted install block plus a create mastra quickstart, and Develop gives the single mastra dev command that opens Studio on port 4111. One clear path: scaffold with npm create mastra@latest or create an Agent class manually, register it in the Mastra instance, and run Studio with npm run dev.
Find the exact limits
FAILFAIL consensus from 1 PARTIAL, 2 FAIL.
The platform API says rate limits are unpublished, while the environments page says the environment allowance depends on the plan without stating a number. No page in the documentation states a request rate limit for the Mastra platform, and the only exact quotas (100K events, 24 CPU hours, 15 days retention on Starter) live on the marketing pricing page, which never states the per-plan environment count the docs defer to. The docs explicitly state that rate limits are not published contracts. No page documents exact rate limits or plan quotas for the Mastra platform. The Mastra Memory Gateway (a separate product at gateway.mastra.ai) has limits, but the main product docs have none.
Recover from a failed step
PASSPASS consensus from 3 PASS.
The error-handling page shows a failed fetch, step and workflow retries, result inspection, and onError handling. One page carries the whole correction path: failed result status, per-step error inspection, step-level retries, workflow-level retryConfig, onError, and a branch fallback, though there is no catalogue of error codes and retryConfig is absent from the Workflow class reference. Error handling is documented with retry policies at workflow and step level, lifecycle callbacks (onFinish, onError), conditional branching, and result status inspection. No standalone error-reference page exists, but the error-handling page serves that role for workflows.
Authenticate the server
PASSPASS consensus from 2 PASS, 1 PARTIAL.
The JWT page covers package installation, token creation, server configuration, Bearer requests, and shared-secret verification. Install, configure, mint a token, and call with curl are all documented end to end, but no page states the signing algorithm or which claims are validated, so the token has to be produced through the jwt.io walkthrough rather than generated programmatically. Full path documented: install @mastra/auth, configure MastraJwtAuth with a shared secret, generate a JWT via jwt.io, send authenticated requests through MastraClient with an Authorization header. The same page covers server config and client usage.
Use the TypeScript SDK
PASSPASS consensus from 3 PASS.
The guide installs @mastra/client-js, retrieves an agent, and calls generate('Hello'); the API reference supports the same string form. @mastra/client-js is named as the official client and the minimal getAgent().generate() example matches the string-prompt form shown in the Agents API reference and in the JWT guide. The official @mastra/client-js package is documented with a minimal working example. The API form (client.getAgent().generate()) is consistent across the MastraClient page, the Agents API page, and the server-side usage examples.
The receipt
Because the API is unversioned, backwards compatibility isn't guaranteed. Rate limits, retention, and ingestion-to-query freshness aren't published contracts.
The platform API says rate limits are unpublished, while the environments page says the environment allowance depends on the plan without stating a number.
Agent surface notes
Initialize returned HTTP 401 with WWW-Authenticate Bearer and resource_metadata resolving to a 200 OAuth protected-resource document.
Clicking the docs Ask AI control opened a Kapa chat panel with an "Ask me a question about Mastra..." input.
Show the score
Paste this into a readme:
[](https://docsforagents.com/reports/mastra-docs-ai-agent-readiness/) Method note
This is a reading test of public documentation, not an execution test. No accounts were created and no API calls were run. The AI Agent Readiness Score counts fifteen reading votes at PASS 2, PARTIAL 1, and FAIL 0, for 30 possible points. Five agent surface checks add 10 points each. The total is 80. Consensus chips show each row majority and do not affect scoring. The panel split on 2 of five tasks. Quotes shown here were re-fetched and confirmed verbatim on 2026-09-22.
Put another docs site through the battery.
Nominate a docs site