crosea.io
robots.txt

Robots Exclusion Standard data for crosea.io

Resource Scan

Scan Details

Site Domain crosea.io
Base Domain crosea.io
Scan Status Ok
Last Scan5/14/2025, 5:32:04 AM
Next Scan 6/13/2025, 5:32:04 AM

Last Scan

Scanned5/14/2025, 5:32:04 AM
URL https://crosea.io/robots.txt
Domain IPs 104.21.66.9, 172.67.154.121, 2606:4700:3030::ac43:9a79, 2606:4700:3032::6815:4209
Response IP 172.67.154.121
Found Yes
Hash 89db87066f571ce559b845c2a82113911d233f3be1cd7c6aeb3b0e1c97d7bfe6
SimHash 6154ddd57693

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://crosea.io/sitemap.xml