Log In Sign Up

raceroster.com
robots.txt

Robots Exclusion Standard data for raceroster.com

Resource Scan

Scan Details

Site Domain raceroster.com
Base Domain raceroster.com
Scan Status Ok
Last Scan2025-10-30T22:17:23+00:00
Next Scan 2025-11-06T22:17:23+00:00

Last Scan

Scanned2025-10-30T22:17:23+00:00
URL https://raceroster.com/robots.txt
Domain IPs 13.35.37.126, 13.35.37.26, 13.35.37.83, 13.35.37.92
Response IP 13.35.37.92
Found Yes
Hash a6b1c7e108081b530372b75fd46c174d07fd18ee244e470b2d2a3a013b42af9e
SimHash dd7cdcd3daf2

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /signin
Disallow /events/2020/
Disallow /events/2019/
Disallow /events/2018/
Disallow /events/2017/
Disallow /events/2016/
Disallow /events/2015/
Disallow /unsubscribe/

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /signin
Disallow /events/2020/
Disallow /events/2019/
Disallow /events/2018/
Disallow /events/2017/
Disallow /events/2016/
Disallow /events/2015/
Disallow /unsubscribe/

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://sitemap.raceroster.com/sitemaps/sitemap.xml
Back to top

Comments

  • https://www.semrush.com/bot/
  • https://moz.com/researchtools/ose/dotbot
  • http://webmeup-crawler.com/
  • https://ahrefs.com/robot/
  • https://www.mj12bot.com/
Back to top