htguys.com
robots.txt
Robots Exclusion Standard data for htguys.com
Resource Scan
Scan Details
| Site Domain | htguys.com |
| Base Domain | htguys.com |
| Scan Status | Ok |
| Last Scan | 2025-10-20T01:18:58+00:00 |
| Next Scan | 2025-10-27T01:18:58+00:00 |
Last Scan
| Scanned | 2025-10-20T01:18:58+00:00 |
| URL | https://htguys.com/robots.txt |
| Redirect | https://www.htguys.com/robots.txt |
| Redirect Domain | www.htguys.com |
| Redirect Base | htguys.com |
| Domain IPs | 198.185.159.160, 198.185.159.161, 198.49.23.160, 198.49.23.161 |
| Redirect IPs | 198.185.159.160, 198.185.159.161, 198.49.23.160, 198.49.23.161 |
| Response IP | 198.49.23.161 |
| Found | Yes |
| Hash | a0d593736699da134af3268d84224d2745f59d9e97468ca0e86bedfe88fb0377 |
| SimHash | 3c4973f2afde |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /display/admin/ |
| Disallow | /display/Search |
| Disallow | /display/Login |
| Disallow | /display/RecoverPassword |
| Disallow | /login |
| Disallow | /contributor |
| Disallow | /podcasts/category |
| Disallow | /podcasts/week |
| Disallow | /podcasts/month |
| Disallow | /podcasts/recommend |
| Disallow | /podcasts/author |
| Disallow | /news/category |
| Disallow | /news/week |
| Disallow | /news/month |
| Disallow | /news/recommend |
| Disallow | /news/author |
| Disallow | /search |
Comments