cbot.ai
robots.txt

Robots Exclusion Standard data for cbot.ai

Resource Scan

Scan Details

Site Domain cbot.ai
Base Domain cbot.ai
Scan Status Ok
Last Scan2025-10-01T07:45:30+00:00
Next Scan 2025-10-31T07:45:30+00:00

Last Scan

Scanned2025-10-01T07:45:30+00:00
URL https://cbot.ai/robots.txt
Redirect https://www.cbot.ai/robots.txt
Redirect Domain www.cbot.ai
Redirect Base cbot.ai
Domain IPs 35.231.210.17
Redirect IPs 35.231.210.17
Response IP 35.231.210.17
Found Yes
Hash 520520bd598921d06d6cc210bf2eb880550caee0d2bf10ae0f1f41b9a1a10a01
SimHash 410108000d93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.cbot.ai/sitemap.xml