rastrex.com
robots.txt

Robots Exclusion Standard data for rastrex.com

Resource Scan

Scan Details

Site Domain rastrex.com
Base Domain rastrex.com
Scan Status Ok
Last Scan2025-10-07T04:59:35+00:00
Next Scan 2025-11-06T04:59:35+00:00

Last Scan

Scanned2025-10-07T04:59:35+00:00
URL http://rastrex.com/robots.txt
Redirect https://rastreo-ec.webnode.es/robots.txt
Redirect Domain rastreo-ec.webnode.es
Redirect Base webnode.es
Domain IPs 84.247.172.22
Redirect IPs 18.185.25.67, 3.79.173.192
Response IP 3.79.173.192
Found Yes
Hash a9625b7f7e62f7fc81e58a501800a1483e66fe68eae99937f234ff01915bce5a
SimHash 685cdc94c333

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://rastreo-ec.webnode.es/sitemap.xml