Published 2026-09-21 · Tested 2026-08-20
Neo4j
FNeo4j received 11 PASS votes and passed 2 of five agent surface checks. The clearest finding came from the find the exact limits task.
Three AI models, GPT 5.6 Sol, Claude Opus 5, and DeepSeek v4 Flash, each read Neo4j’s public documentation independently and attempted five first-hour developer jobs: create the first graph, find the exact limits, recover from a transient driver error, authenticate an AuraDB connection, use the Python driver.
No accounts, API calls, or code execution were used. Every verdict came from public pages and every published quotation passed a live verification check. Preflight substitutions: T3: Transient driver-error recovery replaces HTTP 429. T4: AuraDB driver authentication replaces webhooks.
Freshness
How rechecks work- Category
- Databases & analytics
- Tested
- Quotes verified
- Surface rechecked
No confirmed change since the test.
5 of 5 quoted passages still appear on the live pages.
57.5% · 46/80 · AI Agent Readiness Score · reading 30 pts · surface 50 pts
Agent surface checks · 20/50
The Reading Test
| Task | GPT 5.6 Sol | Opus 5 | DeepSeek v4F | Consensus |
|---|---|---|---|---|
| Create the first graph | PASS | PASS | PARTIAL | PASS |
| Find the exact limits | PARTIAL | PARTIAL | PARTIAL | PARTIAL |
| Recover from a transient driver error | PASS | PASS | PASS | PASS |
| Authenticate an AuraDB connection | PASS | PASS | PASS | PASS |
| Use the Python driver | PASS | PASS | PASS | PASS |
docs platform: Antora and Asciidoctor (unscored) · verified 2026-08-20
What to fix first
These 4 fixes could add up to 33 points to the AI Agent Readiness Score. The list ranks each fix by the points it would add. How the ranking works
- 1 +10 points llms-full.txt check failed
Found: HTTP 404 returned an HTML error page.
Fix: Publish llms-full.txt at the docs root with the full text of every docs page in one plain-text file.
- 2 +10 points Markdown mirror check failed
Found: The tested .md routes returned HTML 404 pages.
Fix: Serve every docs page as Markdown at its URL plus .md, and return the same Markdown for Accept: text/markdown.
Evidence: neo4j.com/
docs/ python-manual/ current/ connect.md (opens in a new tab) - 3 +10 points MCP server check failed
Found: Candidate endpoints did not return an MCP response or OAuth challenge.
Fix: Run a public MCP server for the docs that answers a JSON-RPC initialize call and offers a docs search tool.
Evidence: neo4j.com/
docs/ mcp (opens in a new tab) - 4
Found: Pages give AuraDB Free 200k or 50,000 nodes and conflicting backup rules, and no page states Free memory or storage.
Fix: Publish AuraDB Free graph, memory, storage, and backup limits once in the Aura docs, and reuse those values everywhere.
Evidence: neo4j.com/
cloud/ platform/ aura-graph-database/ faq (opens in a new tab)
What the docs get right
- Recover from a transient driver error: 3 PASS votes. The manual covers transient failures, managed retries, is_retryable(), and idempotent callbacks; four supporting-reference fetches returned HTTP 403.
- Authenticate an AuraDB connection: 3 PASS votes. The credential file supplies URI, username, password, and database; driver pages define neo4j+s encryption and verify connectivity.
- 2 of 5 agent surface checks. Present: llms.txt, docs AI. Missing: llms-full.txt, markdown mirrors, an MCP server.
Create the first graph
PASSPASS consensus from 2 PASS, 1 PARTIAL.
Aura creation and credential pages feed directly into one Python example that connects, creates the graph, and queries it. One unambiguous chain runs from Create an account to Create an instance to Connect to an instance to the Cypher tutorial, which supplies runnable MERGE statements that write nodes and relationships and then a MATCH query, and the create-instance page warns that the generated password "will not be recoverable after". The Aura overview page tells you where to go but does not provide step-by-step console instructions for creating an instance; the Python manual covers connection, data creation, and querying, but the end-to-end path requires cross-referencing separate pages and guessing the console workflow.
Find the exact limits
PARTIALPARTIAL consensus from 3 PARTIAL.
Official pages disagree on Free graph and backup limits, omit exact Free RAM and storage, and differ on paid maxima. Backup retention days per tier and the storage quota of twice RAM are stated in the docs, but the AuraDB Free graph-size ceiling of 200k nodes and 400k relationships appears only on the marketing FAQ and never under /docs/, no Free memory or storage figure is published anywhere, and the Free snapshot rules contradict each other across three docs pages. Free tier node/relationship limits are only stated on a marketing page, not in the technical documentation; the pricing page uses an unresolved footnote; free tier storage is not specified; paid-tier memory and backup values are fully listed and consistent.
Recover from a transient driver error
PASSPASS consensus from 3 PASS.
The manual covers transient failures, managed retries, is_retryable(), and idempotent callbacks; four supporting-reference fetches returned HTTP 403. The docs supply a first-class retryability predicate, state that execute_read and execute_write retry transient failures automatically until the configured maximum retry time, require transaction functions to be idempotent, and state that explicit transactions run "without the automatic retries provided by managed transactions". Managed transactions auto-retry transient failures; the is_retryable() method is documented for manual inspection; idempotency requirements for transaction functions are explicitly stated; the complete recovery path is documented on a single page.
Authenticate an AuraDB connection
PASSPASS consensus from 3 PASS.
The credential file supplies URI, username, password, and database; driver pages define neo4j+s encryption and verify connectivity. Connecting applications names the three required inputs, the Python connect page shows GraphDatabase.driver plus .verify_connectivity() and an Aura-specific dotenv variant, and Advanced connection information marks the neo4j+s scheme as "Default for Aura" with CA-signed-certificate encryption. The connection URI format with the encrypted neo4j+s:// scheme is documented; the dotenv file workflow from Aura is explained; driver instantiation with auth tuple and verify_connectivity() covers the full authentication and verification path.
Use the Python driver
PASSPASS consensus from 3 PASS.
The current manual installs neo4j, connects with GraphDatabase.driver, and runs a parameterized Driver.execute_query() example. pip install neo4j with a stated Python >= 3.10 floor, a server-compatibility matrix for the 6.x driver, and runnable execute_query examples that pass $name and $friendName as keyword arguments alongside the database_ configuration parameter the same manual tells you to always set. Installation via pip is documented; the connection example uses GraphDatabase.driver() with a with statement; the parameterized Cypher query uses $placeholders; the MATCH example is consistent with the CREATE example; all examples match current API guidance.
The receipt
AuraDB Free provides a single database supporting up to 200k nodes and 400k relationships.
Official pages disagree on Free graph and backup limits, omit exact Free RAM and storage, and differ on paid maxima.
Agent surface notes
Candidate endpoints did not return an MCP response or OAuth challenge.
Live manual pages expose Neo4j's public documentation chatbot control.
Show the score
Paste this into a readme:
[](https://docsforagents.com/reports/neo4j-docs-ai-agent-readiness/) Method note
This is a reading test of public documentation, not an execution test. No accounts were created and no API calls were run. The AI Agent Readiness Score counts fifteen reading votes at PASS 2, PARTIAL 1, and FAIL 0, for 30 possible points. Five agent surface checks add 10 points each. The total is 80. Consensus chips show each row majority and do not affect scoring. The panel split on 1 of five tasks. Quotes shown here were re-fetched and confirmed verbatim on 2026-08-20.
Put another docs site through the battery.
Nominate a docs site