booksread.biz
robots.txt
Robots Exclusion Standard data for booksread.biz
Resource Scan
Scan Details
| Site Domain | booksread.biz |
| Base Domain | booksread.biz |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-15T02:37:21+00:00 |
| Next Scan | 2024-12-14T02:37:21+00:00 |
Last Successful Scan
| Scanned | 2024-02-19T02:10:14+00:00 |
| URL | https://booksread.biz/robots.txt |
| Domain IPs | 104.21.52.8, 172.67.192.199, 2606:4700:3033::6815:3408, 2606:4700:3034::ac43:c0c7 |
| Response IP | 104.21.52.8 |
| Found | Yes |
| Hash | 3571ef706ace4e781256e4369bbb1eb78e646578e71aca5cf2c0b00824502a02 |
| SimHash | ac0118216ff3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax |
| Disallow | /ajax/* |
| Disallow | /admin |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /search |
| Disallow | /system |
| Disallow | /install |
| Disallow | /install/* |
| Disallow | /registration |
| Disallow | /users/*/edit |
| Disallow | /users/*/lost |
| Disallow | /require-maxsite |
| Disallow | /require-maxsite/* |
| Disallow | /password-recovery |
Other Records
| Field | Value |
|---|---|
| sitemap | https://booksread.biz/sitemap.xml |
Warnings
- `host` is not a known field.