fanwiki.wiki
robots.txt

Robots Exclusion Standard data for fanwiki.wiki

Resource Scan

Scan Details

Site Domain fanwiki.wiki
Base Domain fanwiki.wiki
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-07T09:48:31+00:00
Next Scan 2026-04-07T09:48:31+00:00

Last Successful Scan

Scanned2023-03-24T06:55:56+00:00
URL https://fanwiki.wiki/robots.txt
Domain IPs 104.21.89.126, 172.67.189.68, 2606:4700:3033::ac43:bd44, 2606:4700:3037::6815:597e
Response IP 172.67.189.68
Found Yes
Hash 1da2669fc0f9c002e7b98fc483c4f6b85da58b024d2ca96d59af18d39323a631
SimHash 67019c6143b0

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://fanwiki.wiki/sitemap.xml

Warnings

  • `host` is not a known field.