docs.cros.world
robots.txt

Robots Exclusion Standard data for docs.cros.world

Resource Scan

Scan Details

Site Domain docs.cros.world
Base Domain cros.world
Scan Status Ok
Last Scan2025-08-16T09:55:57+00:00
Next Scan 2025-09-15T09:55:57+00:00

Last Scan

Scanned2025-08-16T09:55:57+00:00
URL https://docs.cros.world/robots.txt
Domain IPs 104.18.40.47, 172.64.147.209, 2606:4700:4400::6812:282f, 2606:4700:4400::ac40:93d1
Response IP 104.18.40.47
Found Yes
Hash d8c6f173193745c0dd29358cfdf5c06daac36efef418e00df67459f4a662ce60
SimHash c901db40c517

Groups

*

Rule Path
Allow /~gitbook/image?*
Allow /~gitbook/icon?*
Disallow /*?
Allow /

Other Records

Field Value
sitemap https://docs.cros.world/sitemap.xml