Log In Sign Up

springpeople.com
robots.txt

Robots Exclusion Standard data for springpeople.com

Resource Scan

Scan Details

Site Domain springpeople.com
Base Domain springpeople.com
Scan Status Ok
Last Scan2025-08-25T10:09:23+00:00
Next Scan 2025-09-24T10:09:23+00:00

Last Scan

Scanned2025-08-25T10:09:23+00:00
URL https://springpeople.com/robots.txt
Redirect https://www.springpeople.com/robots.txt
Redirect Domain www.springpeople.com
Redirect Base springpeople.com
Domain IPs 65.2.112.195
Redirect IPs 65.2.112.195
Response IP 65.2.112.195
Found Yes
Hash 69bf7f89232785eb59936bd304c8aa00250123f4a4664e7204d30faaff019378
SimHash fc7c8dc34a83

Groups

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

user-agent: ia_archiver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /consultants/
Disallow /img/
Disallow /directory/
Disallow /catalog/
Disallow /checkout/
Disallow /trainer/*/product/
Disallow /class-*
Disallow /simple-training-calendar
Disallow /simple-training-calendar-filter
Disallow /relatedproducts/index/index
Disallow /blog/wp-content/uploads/*

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://www.springpeople.com/sitemap.xml
sitemap https://www.springpeople.com/blog/sitemap.xml
Back to top

Comments

  • ----------------------
  • https://ahrefs.com
  • https://semrush.com
  • https://semrush.com
  • https://apple.com Siri
  • https://support.alexa.com Alexa
  • https://moz.com
  • http://napoveda.seznam.cz
  • https://monitorbacklinks.com
  • https://turnitin.com
  • http://commoncrawl.org
  • https://napoveda.seznam.cz
  • http://help.coccoc.com/search-engine
  • Yandex
  • Info (English): http://help.goo.ne.jp/help/article/853/
  • Info: http://help.naver.com/customer/etc/webDocument02.nhn
  • Info: http://www.baidu.com/search/spider.htm
  • Info: http://www.sogou.com/docs/help/webmasters.htm#07
  • Info: http://www.youdao.com/help/webmaster/spider/
  • ----------------------
  • ----------------------
  • FULL access to all
  • Disallow: /*?*
Back to top