opennetinitiative.net
robots.txt
Robots Exclusion Standard data for opennetinitiative.net
Resource Scan
Scan Details
| Site Domain | opennetinitiative.net |
| Base Domain | opennetinitiative.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-08-28T02:30:10+00:00 |
| Next Scan | 2025-09-04T02:30:10+00:00 |
Last Successful Scan
| Scanned | 2025-07-27T23:25:43+00:00 |
| URL | https://opennetinitiative.net/robots.txt |
| Redirect | https://www.opennetinitiative.net/robots.txt |
| Redirect Domain | www.opennetinitiative.net |
| Redirect Base | opennetinitiative.net |
| Domain IPs | 109.234.160.82 |
| Redirect IPs | 109.234.160.82 |
| Response IP | 109.234.160.82 |
| Found | Yes |
| Hash | 67ec8703b5eb803123293772d0084751fbb5454db236d11bc44bd4e5526cf878 |
| SimHash | 49801d040f70 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-login.php |
| Disallow | */trackback |
| Disallow | /*/feed |
| Disallow | /*/comments |
| Disallow | /cgi-bin |
| Disallow | /*.php$ |
| Disallow | /*.inc$ |
| Disallow | /*.gz |
| Disallow | /*.cgi |
| Disallow | /view |
| Disallow | /documents/ |
| Disallow | |
| Allow | /*css?* |
| Allow | /*js?* |