neo4j.com
robots.txt

Robots Exclusion Standard data for neo4j.com

Resource Scan

Scan Details

Site Domain neo4j.com
Base Domain neo4j.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-14T14:34:18+00:00
Next Scan 2024-09-21T14:34:18+00:00

Last Successful Scan

Scanned2024-08-30T10:01:47+00:00
URL https://neo4j.com/robots.txt
Domain IPs 13.33.88.104, 13.33.88.7, 13.33.88.92, 13.33.88.96, 2600:9000:223b:1e00:6:ae26:4c0:93a1, 2600:9000:223b:2c00:6:ae26:4c0:93a1, 2600:9000:223b:4a00:6:ae26:4c0:93a1, 2600:9000:223b:5200:6:ae26:4c0:93a1, 2600:9000:223b:7400:6:ae26:4c0:93a1, 2600:9000:223b:8000:6:ae26:4c0:93a1, 2600:9000:223b:b000:6:ae26:4c0:93a1, 2600:9000:223b:ce00:6:ae26:4c0:93a1
Response IP 13.33.88.104
Found Yes
Hash b15c96d4650edafd278ec5ed6626d4987e5dae1adcfcf32733ad3d6bddbde00e
SimHash 669152c233c7

Groups

*

Rule Path
Allow /
Allow /docs/*/current
Allow /docs/aura
Allow /docs/dataflow-bigquery
Allow /docs/dataflow-google-cloud
Allow /docs/getting-started
Allow /docs/kafka
Allow /docs/kafka-streams
Allow /docs/cypher-cheat-sheet
Allow /docs/index.html
Allow /docs/sitemap_index.xml
Allow /docs/create-applications
Allow /docs/connectors
Allow /docs/developer-tools
Allow /docs/resources
Allow /docs/security-docs
Allow /videos/$
Disallow /docs/labs
Disallow /components
Disallow /docs/*/*
Disallow /docs/*.*
Disallow /docs/java-reference/current/javadocs
Disallow /docs/api/java-driver/current/index.html?*
Disallow /docs/*/toc.html
Disallow /training_content/*
Disallow /tag/

Other Records

Field Value
sitemap https://neo4j.com/sitemap_index.xml
sitemap https://neo4j.com/docs/sitemap_index.xml

Comments

  • Allow all current docs
  • Allow docs that do not use /current
  • Cheat sheet uses /5/ and /4/
  • Allow docs home and related pages