Log In Sign Up

footish.se
robots.txt

Robots Exclusion Standard data for footish.se

Resource Scan

Scan Details

Site Domain footish.se
Base Domain footish.se
Scan Status Ok
Last Scan2024-05-26T00:22:59+00:00
Next Scan 2024-06-25T00:22:59+00:00

Last Scan

Scanned2024-05-26T00:22:59+00:00
URL https://footish.se/robots.txt
Redirect https://www.footish.se/robots.txt
Redirect Domain www.footish.se
Redirect Base footish.se
Domain IPs 20.73.126.218, 20.73.126.220, 20.73.126.222, 20.73.126.223
Redirect IPs 184.27.123.26, 184.27.123.67, 2600:1413:b000:14::b857:c153, 2600:1413:b000:14::b857:c15c
Response IP 184.27.123.67
Found Yes
Hash cfbc41f4447a346288327b799b62a98d65eb2e439d12e702743463d2d133ad4f
SimHash 8c6041020302

Groups

yandex

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

redbot

Rule Path
Disallow /
Back to top

Comments

  • Yandex (RU) http://yandex.com/bots gives us no information on Yandex-specific robots.txt usage.
  • Goo (JP) http://help.goo.ne.jp/help/article/853/
  • Naver (KR) http://help.naver.com/customer/etc/webDocument02.nhn
  • Baidu (CN) http://www.baidu.com/search/spider.htm
  • SoGou (CN) http://www.sogou.com/docs/help/webmasters.htm#07
  • Youdao (CN) http://www.youdao.com/help/webmaster/spider/
  • Haosou (CN) http://www.haosou.com/help/help_3_2.html
  • Rediff (IN) www.rediff.com
Back to top

Warnings

  • 1 invalid line.
Back to top