anandtech.net
robots.txt
Robots Exclusion Standard data for anandtech.net
Resource Scan
Scan Details
| Site Domain | anandtech.net |
| Base Domain | anandtech.net |
| Scan Status | Ok |
| Last Scan | 2025-07-31T21:28:35+00:00 |
| Next Scan | 2025-08-07T21:28:35+00:00 |
Last Scan
| Scanned | 2025-07-31T21:28:35+00:00 |
| URL | http://anandtech.net/robots.txt |
| Redirect | https://www.anandtech.com/robots.txt |
| Redirect Domain | www.anandtech.com |
| Redirect Base | anandtech.com |
| Domain IPs | 192.64.119.22 |
| Redirect IPs | 52.222.144.31, 52.222.144.41, 52.222.144.74, 52.222.144.93 |
| Response IP | 18.165.72.104 |
| Found | Yes |
| Hash | 02a889bd3726facc0dcdf0cbe4e7b9a4451396e47cc288117ebe6a8437307934 |
| SimHash | c110c1406352 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /comments/* |
| Disallow | /SearchResults |
| Disallow | /Comment/NewComment/* |
| Disallow | /Comment/* |
| Disallow | /comment/* |
| Disallow | /Gallery/* |
| Disallow | /gallery/* |
| Disallow | /Print/* |
| Disallow | /print/* |
| Disallow | /Account/* |
| Disallow | /account/* |
| Allow | / |