anandtech.com
robots.txt
Robots Exclusion Standard data for anandtech.com
Resource Scan
Scan Details
| Site Domain | anandtech.com |
| Base Domain | anandtech.com |
| Scan Status | Ok |
| Last Scan | 2024-10-04T07:25:08+00:00 |
| Next Scan | 2024-10-11T07:25:08+00:00 |
Last Scan
| Scanned | 2024-10-04T07:25:08+00:00 |
| URL | https://anandtech.com/robots.txt |
| Redirect | https://www.anandtech.com/robots.txt |
| Redirect Domain | www.anandtech.com |
| Redirect Base | anandtech.com |
| Domain IPs | 52.222.144.31, 52.222.144.41, 52.222.144.74, 52.222.144.93 |
| Redirect IPs | 18.172.112.101, 18.172.112.66, 18.172.112.68, 18.172.112.9 |
| Response IP | 108.156.22.115 |
| Found | Yes |
| Hash | 02a889bd3726facc0dcdf0cbe4e7b9a4451396e47cc288117ebe6a8437307934 |
| SimHash | c110c1406352 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /comments/* |
| Disallow | /SearchResults |
| Disallow | /Comment/NewComment/* |
| Disallow | /Comment/* |
| Disallow | /comment/* |
| Disallow | /Gallery/* |
| Disallow | /gallery/* |
| Disallow | /Print/* |
| Disallow | /print/* |
| Disallow | /Account/* |
| Disallow | /account/* |
| Allow | / |