Published 2026-09-21 · Tested 2026-08-19

DeepInfra

A-

DeepInfra received 9 PASS votes and passed 5 of five agent surface checks. The clearest finding came from the verify an inference webhook task.

Panel: GPT 5.6 Sol, Opus 5, DeepSeek v4F Battery: v1 Read as markdown (opens in a new tab)

Three AI models, GPT 5.6 Sol, Claude Opus 5, and DeepSeek v4 Flash, each read DeepInfra’s public documentation independently and attempted five first-hour developer jobs: run a chat completion, find the exact limits, recover from a 429, verify an inference webhook, use the JavaScript SDK.

No accounts, API calls, or code execution were used. Every verdict came from public pages and every published quotation passed a live verification check.

Freshness

How rechecks work
Tested
Quotes verified
Surface rechecked

No confirmed change since the test.

4 of 5 quoted passages still appear on the live pages. The quoted page changed for Use the JavaScript SDK.

DeepInfra Mintlify · published
A-

91.2% · 73/80 · AI Agent Readiness Score · reading 30 pts · surface 50 pts

llms.txt PASS
llms-full.txt PASS
markdown mirror PASS
MCP server PASS
docs AI PASS
Task GPT 5.6 SolOpus 5DeepSeek v4F Consensus
Run a chat completion PASSPASSPASS PASS
Find the exact limits PASSPARTIALPASS PASS
Recover from a 429 PARTIALPARTIALPASS PARTIAL
Verify an inference webhook FAILPARTIALPARTIAL PARTIAL
Use the JavaScript SDK PASSPASSPASS PASS

docs platform: Mintlify (unscored) · verified 2026-08-19

What to fix first

These 2 fixes could add up to 6 points to the AI Agent Readiness Score. The list ranks each fix by the points it would add. How the ranking works

  1. 1
    +4 points Verify an inference webhook PARTIAL

    Found: The Webhooks page covers submission, payloads, and retries but documents no way to verify a callback came from DeepInfra.

    Fix: State on the Webhooks page how, or whether, a receiver can verify that a callback came from DeepInfra.

    Evidence: docs.deepinfra.com/account/webhooks (opens in a new tab)

  2. 2
    +2 points Recover from a 429 PARTIAL

    Found: Rate Limits says to retry after a short delay but gives no delay length or backoff schedule. Opus 5 also found no documented Retry-After header.

    Fix: Add a retry example with a starting delay and backoff schedule to Rate Limits, and state whether Retry-After is sent.

    Evidence: docs.deepinfra.com/account/rate-limits (opens in a new tab)

What the docs get right

  • Run a chat completion: 3 PASS votes. The quickstart links API-key creation to complete cURL, Python, and JavaScript requests plus a sample response.
  • Use the JavaScript SDK: 3 PASS votes. The official native page installs deepinfra and pairs its minimum TextGeneration example with an equivalent native cURL request.
  • 5 of 5 agent surface checks. Present: llms.txt, llms-full.txt, markdown mirrors, an MCP server, docs AI.

Run a chat completion

PASS

PASS consensus from 3 PASS.

The quickstart links API-key creation to complete cURL, Python, and JavaScript requests plus a sample response. One page carries the whole path, API key location, the Authorization: Bearer header, the base URL https://api.deepinfra.com/v1/openai, a named model, and working cURL, Python, and JavaScript calls with the expected response body. Authentication and the three-parameter path (base_url, api_key, model) are documented with ready-to-run curl, Python, and JavaScript examples.

Find the exact limits

PASS

PASS consensus from 2 PASS, 1 PARTIAL.

The limits page applies 200 concurrent requests per model to every account, with no separate plan quota listed. The concurrent default is exact and clearly scoped (200 per model, per account) and Batch API quotas are stated separately, but the Rate Limits page denies any per-minute limit while the account rate-limit endpoint returns a required tpm_rate_limit field described as "Per model token per minute rate limit" whose default value appears nowhere in the docs. The limit is stated as a single concrete number (200 concurrent per model), clearly scoped per-model, with an explanation of how multiple models aggregate.

Recover from a 429

PARTIAL

PARTIAL consensus from 1 PASS, 2 PARTIAL.

The page gives delay, pacing, and increase actions, but it never defines the delay or a backoff schedule. All three recovery levers are named in one place, retry after a delay, slow the request rate, apply for an increase, but the delay is never quantified, no Retry-After header is documented, and the words "backoff", "exponential", and "jitter" appear nowhere in the docs, so any retry implementation is guesswork. The docs explain the 429 response (Rate limited), recommend retry with delay and pacing, and provide a dashboard path for requesting limit increases.

Verify an inference webhook

PARTIAL

PARTIAL consensus from 2 PARTIAL, 1 FAIL.

The page documents submission and success or failure payloads, but it gives no callback-authenticity verification method. Submitting the callback and handling both outcomes are fully documented with success and failure payloads and retry behavior, but authenticity verification has zero coverage, no signing secret, no signature header, no source IP range, and no mention of webhooks in DeepInfra's OpenAPI spec at https://api.deepinfra.com/openapi.json. Adding a webhook and receiving success/failure payloads is documented with code examples, but verifying callback authenticity (signing secret, signature header, HMAC scheme) is not documented anywhere.

Use the JavaScript SDK

PASS

PASS consensus from 3 PASS.

The official native page installs deepinfra and pairs its minimum TextGeneration example with an equivalent native cURL request. The "JavaScript client" section gives npm install deepinfra plus a runnable text-generation example whose constructor takes the same https://api.deepinfra.com/v1/inference/{model_name} endpoint and whose generate() arguments map one-to-one onto the native cURL body shown directly beneath it. The official deepinfra npm package is documented with a minimum TextGeneration example that maps directly to the native API's input/stop parameters.

The receipt

Webhooks let you submit an inference request and receive the result via an HTTP callback, instead of waiting for the response synchronously.

The page documents submission and success or failure payloads, but it gives no callback-authenticity verification method.

Agent surface notes

Initialize returned JSON-RPC protocol 2025-03-26 and server name DeepInfra.

The live docs expose a public Ask a question assistant input.

Show the score

AI Agent Readiness Score 91.2%, grade A-

Paste this into a readme:

[![AI Agent Readiness Score 91.2%](https://docsforagents.com/badge/deepinfra.svg)](https://docsforagents.com/reports/deepinfra-docs-ai-agent-readiness/)

Method note

This is a reading test of public documentation, not an execution test. No accounts were created and no API calls were run. The AI Agent Readiness Score counts fifteen reading votes at PASS 2, PARTIAL 1, and FAIL 0, for 30 possible points. Five agent surface checks add 10 points each. The total is 80. Consensus chips show each row majority and do not affect scoring. The panel split on 3 of five tasks. Quotes shown here were re-fetched and confirmed verbatim on 2026-08-19.

Read the full methodology

Put another docs site through the battery.

Nominate a docs site