mrbook22.net
robots.txt
Robots Exclusion Standard data for mrbook22.net
Resource Scan
Scan Details
| Site Domain | mrbook22.net |
| Base Domain | mrbook22.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-04-13T02:52:08+00:00 |
| Next Scan | 2025-04-27T02:52:08+00:00 |
Last Successful Scan
| Scanned | 2025-04-04T02:10:01+00:00 |
| URL | https://www.mrbook22.net/robots.txt |
| Redirect | https://mrbook22.net/robots.txt |
| Redirect Domain | mrbook22.net |
| Redirect Base | mrbook22.net |
| Domain IPs | 104.21.2.213, 172.67.129.181, 2606:4700:3031::6815:2d5, 2606:4700:3035::ac43:81b5 |
| Redirect IPs | 104.21.2.213, 172.67.129.181, 2606:4700:3031::6815:2d5, 2606:4700:3035::ac43:81b5 |
| Response IP | 104.21.2.213 |
| Found | Yes |
| Hash | f60279c1e1d7e783a25e9ab8b53c106ab9012ce770be9c4ffd28830466765fc0 |
| SimHash | 63a4dd4a6937 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | /*/*.css |
| Allow | /*/*.js |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /readme.html |
| Disallow | /license.txt |
| Disallow | /xmlrpc.php |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | */disclaimer/* |
| Disallow | *?attachment_id= |
| Disallow | /privacy-policy |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Comments