Published 2026-09-21 · Tested 2026-08-19
DeepInfra
A-DeepInfra received 9 PASS votes and passed 5 of five agent surface checks. The clearest finding came from the verify an inference webhook task.
Three AI models, GPT 5.6 Sol, Claude Opus 5, and DeepSeek v4 Flash, each read DeepInfra’s public documentation independently and attempted five first-hour developer jobs: run a chat completion, find the exact limits, recover from a 429, verify an inference webhook, use the JavaScript SDK.
No accounts, API calls, or code execution were used. Every verdict came from public pages and every published quotation passed a live verification check.
Freshness
How rechecks work- Category
- AI models & inference
- Tested
- Quotes verified
- Surface rechecked
No confirmed change since the test.
4 of 5 quoted passages still appear on the live pages. The quoted page changed for Use the JavaScript SDK.
91.2% · 73/80 · AI Agent Readiness Score · reading 30 pts · surface 50 pts
Agent surface checks · 50/50
The Reading Test
| Task | GPT 5.6 Sol | Opus 5 | DeepSeek v4F | Consensus |
|---|---|---|---|---|
| Run a chat completion | PASS | PASS | PASS | PASS |
| Find the exact limits | PASS | PARTIAL | PASS | PASS |
| Recover from a 429 | PARTIAL | PARTIAL | PASS | PARTIAL |
| Verify an inference webhook | FAIL | PARTIAL | PARTIAL | PARTIAL |
| Use the JavaScript SDK | PASS | PASS | PASS | PASS |
docs platform: Mintlify (unscored) · verified 2026-08-19
What to fix first
These 2 fixes could add up to 6 points to the AI Agent Readiness Score. The list ranks each fix by the points it would add. How the ranking works
- 1
Found: The Webhooks page covers submission, payloads, and retries but documents no way to verify a callback came from DeepInfra.
Fix: State on the Webhooks page how, or whether, a receiver can verify that a callback came from DeepInfra.
Evidence: docs.deepinfra.com/
account/ webhooks (opens in a new tab) - 2
Found: Rate Limits says to retry after a short delay but gives no delay length or backoff schedule. Opus 5 also found no documented Retry-After header.
Fix: Add a retry example with a starting delay and backoff schedule to Rate Limits, and state whether Retry-After is sent.
Evidence: docs.deepinfra.com/
account/ rate-limits (opens in a new tab)
What the docs get right
- Run a chat completion: 3 PASS votes. The quickstart links API-key creation to complete cURL, Python, and JavaScript requests plus a sample response.
- Use the JavaScript SDK: 3 PASS votes. The official native page installs deepinfra and pairs its minimum TextGeneration example with an equivalent native cURL request.
- 5 of 5 agent surface checks. Present: llms.txt, llms-full.txt, markdown mirrors, an MCP server, docs AI.
Run a chat completion
PASSPASS consensus from 3 PASS.
The quickstart links API-key creation to complete cURL, Python, and JavaScript requests plus a sample response. One page carries the whole path, API key location, the Authorization: Bearer header, the base URL https://api.deepinfra.com/v1/openai, a named model, and working cURL, Python, and JavaScript calls with the expected response body. Authentication and the three-parameter path (base_url, api_key, model) are documented with ready-to-run curl, Python, and JavaScript examples.
Find the exact limits
PASSPASS consensus from 2 PASS, 1 PARTIAL.
The limits page applies 200 concurrent requests per model to every account, with no separate plan quota listed. The concurrent default is exact and clearly scoped (200 per model, per account) and Batch API quotas are stated separately, but the Rate Limits page denies any per-minute limit while the account rate-limit endpoint returns a required tpm_rate_limit field described as "Per model token per minute rate limit" whose default value appears nowhere in the docs. The limit is stated as a single concrete number (200 concurrent per model), clearly scoped per-model, with an explanation of how multiple models aggregate.
Recover from a 429
PARTIALPARTIAL consensus from 1 PASS, 2 PARTIAL.
The page gives delay, pacing, and increase actions, but it never defines the delay or a backoff schedule. All three recovery levers are named in one place, retry after a delay, slow the request rate, apply for an increase, but the delay is never quantified, no Retry-After header is documented, and the words "backoff", "exponential", and "jitter" appear nowhere in the docs, so any retry implementation is guesswork. The docs explain the 429 response (Rate limited), recommend retry with delay and pacing, and provide a dashboard path for requesting limit increases.
Verify an inference webhook
PARTIALPARTIAL consensus from 2 PARTIAL, 1 FAIL.
The page documents submission and success or failure payloads, but it gives no callback-authenticity verification method. Submitting the callback and handling both outcomes are fully documented with success and failure payloads and retry behavior, but authenticity verification has zero coverage, no signing secret, no signature header, no source IP range, and no mention of webhooks in DeepInfra's OpenAPI spec at https://api.deepinfra.com/openapi.json. Adding a webhook and receiving success/failure payloads is documented with code examples, but verifying callback authenticity (signing secret, signature header, HMAC scheme) is not documented anywhere.
Use the JavaScript SDK
PASSPASS consensus from 3 PASS.
The official native page installs deepinfra and pairs its minimum TextGeneration example with an equivalent native cURL request. The "JavaScript client" section gives npm install deepinfra plus a runnable text-generation example whose constructor takes the same https://api.deepinfra.com/v1/inference/{model_name} endpoint and whose generate() arguments map one-to-one onto the native cURL body shown directly beneath it. The official deepinfra npm package is documented with a minimum TextGeneration example that maps directly to the native API's input/stop parameters.
The receipt
Webhooks let you submit an inference request and receive the result via an HTTP callback, instead of waiting for the response synchronously.
The page documents submission and success or failure payloads, but it gives no callback-authenticity verification method.
Agent surface notes
Initialize returned JSON-RPC protocol 2025-03-26 and server name DeepInfra.
The live docs expose a public Ask a question assistant input.
Show the score
Paste this into a readme:
[](https://docsforagents.com/reports/deepinfra-docs-ai-agent-readiness/) Method note
This is a reading test of public documentation, not an execution test. No accounts were created and no API calls were run. The AI Agent Readiness Score counts fifteen reading votes at PASS 2, PARTIAL 1, and FAIL 0, for 30 possible points. Five agent surface checks add 10 points each. The total is 80. Consensus chips show each row majority and do not affect scoring. The panel split on 3 of five tasks. Quotes shown here were re-fetched and confirmed verbatim on 2026-08-19.
Put another docs site through the battery.
Nominate a docs site