Log In Sign Up

schoolpress.sch.gr
robots.txt

Robots Exclusion Standard data for schoolpress.sch.gr

Resource Scan

Scan Details

Site Domain schoolpress.sch.gr
Base Domain sch.gr
Scan Status Ok
Last Scan2024-11-03T11:03:07+00:00
Next Scan 2024-12-03T11:03:07+00:00

Last Scan

Scanned2024-11-03T11:03:07+00:00
URL https://schoolpress.sch.gr/robots.txt
Domain IPs 194.63.238.110
Response IP 194.63.238.110
Found Yes
Hash 301f4045d75a8e8ce1a5de6ac48dd1b4a55a0a43bec36cac5d382002bdda254b
SimHash c0c75bc3820b

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /trackback
Disallow /*/trackback
Disallow */wp-admin

Other Records

Field Value
crawl-delay 10

badbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider/2.0;+http://www.baidu.com/search/spider.html

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sosospider/2.0

Rule Path
Disallow /

sosospider+

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /
Back to top

Comments

  • Disallow: /wp-includes
  • Disallow: /wp-content/plugins
  • Disallow: /wp-content/cache
  • Disallow: /feed
  • Disallow: */feed
  • Disallow: */*/feed
  • Disallow: /comments
  • Disallow: /*/comments
  • Disallow: /category/*/*
  • Disallow: /*/category/*/*
  • Disallow: */wp-includes
  • Disallow: */wp-content/plugins
  • BadBot found in my logs
  • Sitemap: https://blogs.sch.gr/sitemap_ms.xml
Back to top

Warnings

  • 6 invalid lines.
Back to top