nextbillion.ai
robots.txt

Robots Exclusion Standard data for nextbillion.ai

Resource Scan

Scan Details

Site Domain nextbillion.ai
Base Domain nextbillion.ai
Scan Status Ok
Last Scan2025-10-16T22:05:43+00:00
Next Scan 2025-11-15T22:05:43+00:00

Last Scan

Scanned2025-10-16T22:05:43+00:00
URL https://nextbillion.ai/robots.txt
Domain IPs 104.21.93.26, 172.67.203.8, 2606:4700:3031::6815:5d1a, 2606:4700:3036::ac43:cb08
Response IP 104.21.93.26
Found Yes
Hash 8d47cd98f1bfe8ce2fde0e42d786f772530245fd70b6ce6fddd075b0a3a31c5d
SimHash b32898520d96

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*__hstc%3D
Disallow /*__hssc%3D
Disallow /*__hsfp%3D

Other Records

Field Value
sitemap https://nextbillion.ai/sitemap_index.xml

Comments

  • AI model access rules

Warnings

  • `llm-policy` is not a known field.