book-info.com
robots.txt

Robots Exclusion Standard data for book-info.com

Resource Scan

Scan Details

Site Domain book-info.com
Base Domain book-info.com
Scan Status Ok
Last Scan2024-09-28T23:20:25+00:00
Next Scan 2024-10-05T23:20:25+00:00

Last Scan

Scanned2024-09-28T23:20:25+00:00
URL https://book-info.com/robots.txt
Redirect https://www.book-info.com/robots.txt
Redirect Domain www.book-info.com
Redirect Base book-info.com
Domain IPs 62.67.209.19
Redirect IPs 62.67.209.19
Response IP 62.67.209.19
Found Yes
Hash 961fad717417813f60a62c87056343911d59101651f401c73298724d04b5b312
SimHash 92467142e82a

Groups

ia_archiver

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

*

Rule Path
Disallow /asin/
Disallow /service/
Disallow /plugins/

Warnings

  • 2 invalid lines.