fanday.net
robots.txt
Robots Exclusion Standard data for fanday.net
Resource Scan
Scan Details
| Site Domain | fanday.net |
| Base Domain | fanday.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-03T08:58:23+00:00 |
| Next Scan | 2024-11-01T08:58:23+00:00 |
Last Successful Scan
| Scanned | 2023-07-11T07:00:57+00:00 |
| URL | https://fanday.net/robots.txt |
| Domain IPs | 104.21.41.170, 172.67.191.189, 2606:4700:3030::6815:29aa, 2606:4700:3034::ac43:bfbd |
| Response IP | 172.67.191.189 |
| Found | Yes |
| Hash | 62fae80459a344827259594053fd35d7cccc5bbb63108e44bc1626feb9437bda |
| SimHash | e5014a0b3f3b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sign-in |
| Disallow | /sign-out |
| Disallow | /verify-email |
| Disallow | /forgot-password |
| Disallow | /change-password |
| Disallow | /search?term* |
| Disallow | /json/ |
| Disallow | /go/ |
| Disallow | /*admin/ |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*utm_source* |
| Disallow | /*gclid%3D |
| Disallow | /*cf_chl_captcha* |
| Allow | /rss.xml |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fanday.net/sitemap.xml |
| sitemap | https://fanday.net/sitemap.news.xml |
Warnings
- `host` is not a known field.