Log In Sign Up

jefit.com
robots.txt

Robots Exclusion Standard data for jefit.com

Resource Scan

Scan Details

Site Domain jefit.com
Base Domain jefit.com
Scan Status Ok
Last Scan2024-11-14T18:42:42+00:00
Next Scan 2024-11-21T18:42:42+00:00

Last Scan

Scanned2024-11-14T18:42:42+00:00
URL https://jefit.com/robots.txt
Redirect https://www.jefit.com/robots.txt
Redirect Domain www.jefit.com
Redirect Base jefit.com
Domain IPs 64.71.148.72
Redirect IPs 64.71.148.72
Response IP 64.71.148.72
Found Yes
Hash d2fcc06032dcb5bafabc7ddece15d57c0274ab4ed7dc4437f6cd881b575d57b4
SimHash 28153533ecde

Groups

adsbot-google
ahrefsbot
applebot
bingpreview
deepcrawl
googlebot
googlebot-image
googlebot-mobile
mediapartners-google
stc-bot
scoutjet
searchmetricsbot
seznambot
telegrambot
twitterbot
yahoo! slurp
yandex
archive.org_bot
bingbot
ia_archiver
msnbot

Rule Path
Disallow /wp/wp-admin/
Disallow /forum/
Disallow /tutorials/
Disallow /admin/
Disallow /api/
Disallow /user/
Disallow /members/

claudebot

Rule Path
Disallow /wp/wp-admin/
Disallow /forum/
Disallow /tutorials/
Disallow /admin/
Disallow /api/
Disallow /user/
Disallow /members/
Disallow /exercises/
Disallow /routines/
Disallow /build-routine/
Back to top

Other Records

Field Value
sitemap https://www.jefit.com/sitemap.xml
Back to top

Comments

  • By accessing Jefit's website you agree to Jefit's Terms of Service, available at
  • https://www.jefit.com/terms-of-use/
  • If you would like to inquire about crawling Jefit, please contact us at
  • team@jefit.com
  • As always, Asimov's Three Laws are in effect:
  • 1. A robot may not injure a human being or, through inaction, allow a human
  • being to come to harm.
  • 2. A robot must obey orders given it by human beings except where such
  • orders would conflict with the First Law.
  • 3. A robot must protect its own existence as long as such protection does
  • not conflict with the First or Second Law.
  • claudebot is a jerk
  • Zombie routines follow
Back to top