benh.org
robots.txt
Robots Exclusion Standard data for benh.org
Resource Scan
Scan Details
| Site Domain | benh.org |
| Base Domain | benh.org |
| Scan Status | Ok |
| Last Scan | 2025-12-05T18:43:36+00:00 |
| Next Scan | 2025-12-12T18:43:36+00:00 |
Last Scan
| Scanned | 2025-12-05T18:43:36+00:00 |
| URL | https://www.benh.org/robots.txt |
| Domain IPs | 104.21.31.185, 172.67.179.43, 2606:4700:3030::ac43:b32b, 2606:4700:3034::6815:1fb9 |
| Response IP | 172.67.179.43 |
| Found | Yes |
| Hash | dd5bf67a437c08e5bd43d55adfbccc85be895a8e4774bb5700195dab3169d2e1 |
| SimHash | 9020cbeb7316 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /vlog/ |
| Disallow | /techblog/*/feed/$ |
| Disallow | /techblog/*/feed/rss/$ |
| Disallow | /techblog/*/trackback/$ |
| Disallow | /techblog/wp-content |
| Disallow | /techblog/feed/ |
| Disallow | /techblog/trackback/ |
| Disallow | /guestbook.php |
| Disallow | /guest.php |
| Disallow | /support.htm |
| Disallow | /support.php |
| Disallow | /blog/*/feed/$ |
| Disallow | /blog/*/feed/rss/$ |
| Disallow | /blog/*/trackback/$ |
| Disallow | /blog/wp-content |
| Disallow | /blog/feed/ |
| Disallow | /trackback/ |
| Disallow | /dev/ |
| Allow | / |