chantalstainedglass.50megs.com
robots.txt

Robots Exclusion Standard data for chantalstainedglass.50megs.com

Resource Scan

Scan Details

Site Domain chantalstainedglass.50megs.com
Base Domain 50megs.com
Scan Status Ok
Last Scan2024-05-20T07:27:49+00:00
Next Scan 2024-06-19T07:27:49+00:00

Last Scan

Scanned2024-05-20T07:27:49+00:00
URL http://chantalstainedglass.50megs.com/robots.txt
Domain IPs 64.136.20.64
Response IP 64.136.20.64
Found Yes
Hash 330f323afdbca5f1b7c2948b31e6d134a2bbc6f6f4c2db3ad8aa516d85d33f37
SimHash a2d652504103

Groups

slurp

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

msnbot

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$

bingpreview

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

adidxbot

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$

bingbot

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

googlebot

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

baidu

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

baiduspider

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

baiduspider+

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

baiduspider/2.0;+http://www.baidu.com/search/spider.html

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

baiduspider/2.0

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

spider

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

yandex

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

yandex.com

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

yandexbot/3.0

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /images/

sosospider+

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot[at]gmail[dot]com)

Rule Path
Disallow /

teoma

Rule Path
Disallow

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

Comments

  • Baiduspider
  • Yandex
  • Sosospider
  • Sogou
  • Ezooms

Warnings

  • 12 invalid lines.