fastscans.net
robots.txt
Robots Exclusion Standard data for fastscans.net
Resource Scan
Scan Details
Site Domain | fastscans.net |
Base Domain | fastscans.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T10:14:55+00:00 |
Next Scan | 2024-09-24T10:14:55+00:00 |
Last Successful Scan
Scanned | 2024-04-14T23:22:21+00:00 |
URL | https://fastscans.net/robots.txt |
Domain IPs | 104.21.10.221, 172.67.146.206, 2606:4700:3033::6815:add, 2606:4700:3034::ac43:92ce |
Response IP | 172.67.146.206 |
Found | Yes |
Hash | 757d2a648808dd07ce4a116c0f05cdb88360ee329d7969e49c5d1e5c75ef7f94 |
SimHash | 500501100f31 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /vi |
Disallow | /vi/* |
Disallow | /truyen-tranh/*?previousCollectionId=* |
Disallow | /en/comics/*?previousCollectionId=* |
Other Records
Field | Value |
---|---|
sitemap | https://fastscans.net/sitemap/0.xml |
sitemap | https://fastscans.net/sitemap/1.xml |