docus.ai
robots.txt
Robots Exclusion Standard data for docus.ai
Resource Scan
Scan Details
Site Domain | docus.ai |
Base Domain | docus.ai |
Scan Status | Ok |
Last Scan | 2025-02-25T23:25:20+00:00 |
Next Scan | 2025-03-27T23:25:20+00:00 |
Last Scan
Scanned | 2025-02-25T23:25:20+00:00 |
URL | https://docus.ai/robots.txt |
Domain IPs | 104.21.62.78, 172.67.221.206, 2606:4700:3033::ac43:ddce, 2606:4700:3034::6815:3e4e |
Response IP | 172.67.221.206 |
Found | Yes |
Hash | c18c454b0f84288b68cab22326ce5d2a70afe6125fd74599d356c3e9350beb0f |
SimHash | 4808c3a36d23 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /_next/ |
Disallow | /_next/data/*.json |
Disallow | /chat-history/ |
Disallow | /chat-history/* |
Disallow | /reports/* |
Disallow | /reports/ |
Disallow | /api/ |
Disallow | /api/* |
Other Records
Field | Value |
---|---|
sitemap | https://docus.ai/sitemap.xml |