Log In Sign Up

bistrainer.com
robots.txt

Robots Exclusion Standard data for bistrainer.com

Resource Scan

Scan Details

Site Domain bistrainer.com
Base Domain bistrainer.com
Scan Status Ok
Last Scan2024-09-12T22:23:06+00:00
Next Scan 2024-10-12T22:23:06+00:00

Last Scan

Scanned2024-09-12T22:23:06+00:00
URL https://bistrainer.com/robots.txt
Redirect https://www.bistrainer.com/robots.txt
Redirect Domain www.bistrainer.com
Redirect Base bistrainer.com
Domain IPs 15.157.77.235, 15.157.93.41, 3.97.33.36
Redirect IPs 15.157.77.235, 15.157.93.41, 3.97.33.36
Response IP 15.157.93.41
Found Yes
Hash f39fb08ab6a589eba2ec866eca4753b8fa4034ee43533bd97af1870a3fbbc230
SimHash 113c876a5791

Groups

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Allow /store*
Allow /*home.loginForm*
Allow /*home.loginform*
Allow /index.cfm?action=classroom.*
Allow /v1/index.cfm?action=classroom.*
Allow /$
Disallow /
Back to top

Comments

  • this robots file tells search engines not to index eCommerce pages
Back to top