crossroadbg.com
robots.txt

Robots Exclusion Standard data for crossroadbg.com

Resource Scan

Scan Details

Site Domain crossroadbg.com
Base Domain crossroadbg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-24T02:41:09+00:00
Next Scan 2026-04-24T02:41:09+00:00

Last Successful Scan

Scanned2025-06-28T20:15:13+00:00
URL https://crossroadbg.com/robots.txt
Domain IPs 79.124.76.10
Response IP 79.124.76.10
Found Yes
Hash bbf766db29d8b21cfa7a0064de7721bba8bac427c1db3158045f9b722cd11ce7
SimHash 7f455d45c910

Groups

*

Rule Path
Disallow /component/
Disallow /content/
Disallow /administrator/

Other Records

Field Value
sitemap https://www.crossroadbg.com/sitemap.xml