wiki3.jp
robots.txt

Robots Exclusion Standard data for wiki3.jp

Resource Scan

Scan Details

Site Domain wiki3.jp
Base Domain wiki3.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-26T13:12:44+00:00
Next Scan 2024-10-03T13:12:44+00:00

Last Successful Scan

Scanned2024-09-18T13:12:03+00:00
URL https://wiki3.jp/robots.txt
Domain IPs 104.21.16.111, 172.67.211.80, 2606:4700:3037::6815:106f, 2606:4700:3037::ac43:d350
Response IP 104.21.16.111
Found Yes
Hash 5f4d91abe434d2190f156fcce0f9ded6ea9eab10db600d9796a1dd60a15c2ae0
SimHash 3314d34279e0

Groups

*

Rule Path
Disallow
Disallow /*/history/*
Disallow /*/diff/*
Disallow /*/edit/*
Disallow /*/copy/*
Disallow /*/edit?mode=*
Disallow /*/edit
Disallow /*/search
Disallow /*/search_confined
Disallow /*/contact
Disallow /*/db/*/form/*
Disallow /*/db/*/form

mediapartners-google

Rule Path
Allow /

ahrefsbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
petalbot
dotbot
mj12bot

Rule Path
Disallow /

amazonbot
bingbot
linespider
applebot
facebookexternalhit

Rule Path
Disallow /wiki/

femtosearchbot

Rule Path
Disallow *