hostdel.com
robots.txt

Robots Exclusion Standard data for hostdel.com

Resource Scan

Scan Details

Site Domain hostdel.com
Base Domain hostdel.com
Scan Status Ok
Last Scan2025-05-07T23:41:45+00:00
Next Scan 2025-06-06T23:41:45+00:00

Last Scan

Scanned2025-05-07T23:41:45+00:00
URL https://hostdel.com/robots.txt
Redirect https://www.hostdel.com/robots.txt
Redirect Domain www.hostdel.com
Redirect Base hostdel.com
Domain IPs 104.21.42.213, 172.67.166.79, 2606:4700:3031::ac43:a64f, 2606:4700:3033::6815:2ad5
Redirect IPs 104.21.42.213, 172.67.166.79, 2606:4700:3031::ac43:a64f, 2606:4700:3033::6815:2ad5
Response IP 104.21.42.213
Found Yes
Hash a9426a66db8b835c39cae232581a41ef10489857d6abf8080d4c2f639e19caff
SimHash 6977fc7066f1

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /downloads/
Disallow /images/
Disallow /includes/
Disallow /lang/
Disallow /modules/
Disallow /pipe/
Disallow /status/
Disallow /templates/
Disallow /templates/*
Disallow /templates_c/
Disallow /one-moment/
Disallow /assets/
Disallow /attachments/
Disallow /feeds/
Disallow /repository/
Disallow /resources/
Disallow /.well-known/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.hostdel.com/sitemap.xml