htb.com
robots.txt

Robots Exclusion Standard data for htb.com

Resource Scan

Scan Details

Site Domain htb.com
Base Domain htb.com
Scan Status Ok
Last Scan2025-10-13T21:51:03+00:00
Next Scan 2025-11-12T21:51:03+00:00

Last Scan

Scanned2025-10-13T21:51:03+00:00
URL https://htb.com/robots.txt
Domain IPs 172.66.133.224, 172.66.138.40, 2606:4700:10::ac42:85e0, 2606:4700:10::ac42:8a28
Response IP 172.66.133.224
Found Yes
Hash ed17d35b66087da78b46812ff89589272d9796557d0cd2b411f33da64595701b
SimHash c430dc00e712

Groups

*

Rule Path
Disallow /stats/

Other Records

Field Value
crawl-delay 2