fanwuxia.com
robots.txt
Robots Exclusion Standard data for fanwuxia.com
Resource Scan
Scan Details
Site Domain | fanwuxia.com |
Base Domain | fanwuxia.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-28T04:56:31+00:00 |
Next Scan | 2025-01-26T04:56:31+00:00 |
Last Successful Scan
Scanned | 2024-03-26T03:28:36+00:00 |
URL | https://fanwuxia.com/robots.txt |
Redirect | https://novelfire.net/robots.txt |
Redirect Domain | novelfire.net |
Redirect Base | novelfire.net |
Domain IPs | 104.21.5.129, 172.67.133.119, 2606:4700:3031::6815:581, 2606:4700:3031::ac43:8577 |
Redirect IPs | 104.21.29.216, 172.67.171.222, 2606:4700:3032::6815:1dd8, 2606:4700:3035::ac43:abde |
Response IP | 172.67.171.222 |
Found | Yes |
Hash | c5a2e8ed5f8e079298f6f6d63bcfd449167635703c87d002066aba891d84250a |
SimHash | e80081674711 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /search?keyword=* |
Disallow | /api/* |
Disallow | /account/saveReview |
Disallow | /account/likeReview |
Disallow | /auth/* |
Disallow | /callback/* |
Other Records
Field | Value |
---|---|
sitemap | https://novelfire.net/sitemap.xml |