webnovelpub.co
robots.txt
Robots Exclusion Standard data for webnovelpub.co
Resource Scan
Scan Details
| Site Domain | webnovelpub.co |
| Base Domain | webnovelpub.co |
| Scan Status | Ok |
| Last Scan | 2024-11-09T05:12:00+00:00 |
| Next Scan | 2024-11-16T05:12:00+00:00 |
Last Scan
| Scanned | 2024-11-09T05:12:00+00:00 |
| URL | https://webnovelpub.co/robots.txt |
| Domain IPs | 104.21.74.253, 172.67.209.77, 2606:4700:3033::ac43:d14d, 2606:4700:3037::6815:4afd |
| Response IP | 104.21.74.253 |
| Found | Yes |
| Hash | 4be929a6473ff45515ca5cb32d84b93d976cfd3e5c8f008884e89afa0caaf48c |
| SimHash | 480089674711 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/* |
| Disallow | /account/saveReview |
| Disallow | /account/likeReview |
| Disallow | /auth/* |
| Disallow | /callback/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://webnovelpub.co/sitemap.xml |