novelmtl.com
robots.txt
Robots Exclusion Standard data for novelmtl.com
Resource Scan
Scan Details
| Site Domain | novelmtl.com |
| Base Domain | novelmtl.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-27T10:06:08+00:00 |
| Next Scan | 2025-01-25T10:06:08+00:00 |
Last Successful Scan
| Scanned | 2024-04-01T08:33:08+00:00 |
| URL | https://novelmtl.com/robots.txt |
| Redirect | https://www.wuxiaspace.com/robots.txt |
| Redirect Domain | www.wuxiaspace.com |
| Redirect Base | wuxiaspace.com |
| Domain IPs | 104.21.78.219, 172.67.137.166, 2606:4700:3030::ac43:89a6, 2606:4700:3031::6815:4edb |
| Redirect IPs | 104.21.72.140, 172.67.151.40, 2606:4700:3031::6815:488c, 2606:4700:3033::ac43:9728 |
| Response IP | 104.21.72.140 |
| Found | Yes |
| Hash | 3fef711f6027c86dd04ce12834685506b525517b328d1ad34766fbbb810a0168 |
| SimHash | d8400f035157 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
| Disallow | /d/ |
| Disallow | /e/class/ |
| Disallow | /e/config/ |
| Disallow | /e/data/ |
| Disallow | /e/enews/ |
| Disallow | /e/update/ |
Comments