novelreader.to
robots.txt
Robots Exclusion Standard data for novelreader.to
Resource Scan
Scan Details
| Site Domain | novelreader.to |
| Base Domain | novelreader.to |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-08T13:09:31+00:00 |
| Next Scan | 2024-12-07T13:09:31+00:00 |
Last Successful Scan
| Scanned | 2024-05-12T10:32:26+00:00 |
| URL | https://novelreader.to/robots.txt |
| Redirect | https://novelfire.net/robots.txt |
| Redirect Domain | novelfire.net |
| Redirect Base | novelfire.net |
| Domain IPs | 104.21.78.104, 172.67.220.57, 2606:4700:3030::ac43:dc39, 2606:4700:3034::6815:4e68 |
| Redirect IPs | 104.21.29.216, 172.67.171.222, 2606:4700:3032::6815:1dd8, 2606:4700:3035::ac43:abde |
| Response IP | 172.67.171.222 |
| Found | Yes |
| Hash | c5a2e8ed5f8e079298f6f6d63bcfd449167635703c87d002066aba891d84250a |
| SimHash | e80081674711 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search?keyword=* |
| Disallow | /api/* |
| Disallow | /account/saveReview |
| Disallow | /account/likeReview |
| Disallow | /auth/* |
| Disallow | /callback/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://novelfire.net/sitemap.xml |