fanyici.org
robots.txt

Robots Exclusion Standard data for fanyici.org

Resource Scan

Scan Details

Site Domain fanyici.org
Base Domain fanyici.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-10-07T20:47:42+00:00
Next Scan 2024-10-14T20:47:42+00:00

Last Successful Scan

Scanned2024-09-29T20:47:09+00:00
URL https://fanyici.org/robots.txt
Redirect https://www.fanyici.org/robots.txt
Redirect Domain www.fanyici.org
Redirect Base fanyici.org
Domain IPs 43.134.165.11
Redirect IPs 43.134.165.11
Response IP 43.134.165.11
Found Yes
Hash 8698157ba2d04c2c6996c19f12e7508edf0edf16fc40b6e03029f8fb74caaa6b
SimHash 1234bd6ba00a

Groups

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrush

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

python

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

webdup

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

purebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wangidspider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

xbfmozilla

Rule Path
Disallow /

yottaa

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

swebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

turnitinbot-agent

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

perl

Rule Path
Disallow /

python

Rule Path
Disallow /

wget

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

outfoxbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.