leftfootforward.org
robots.txt

Robots Exclusion Standard data for leftfootforward.org

Resource Scan

Scan Details

Site Domain leftfootforward.org
Base Domain leftfootforward.org
Scan Status Ok
Last Scan2024-11-02T05:08:35+00:00
Next Scan 2024-11-09T05:08:35+00:00

Last Scan

Scanned2024-11-02T05:08:35+00:00
URL https://leftfootforward.org/robots.txt
Domain IPs 209.97.188.220
Response IP 209.97.188.220
Found Yes
Hash bae6ed4935ccb7b7ad00c46f40cd8c880305b0d43fae6d5c61af583f1c9c7a07
SimHash 0810dd3349f3

Groups

*

Rule Path
Disallow /uploads/
Disallow /images/2009/
Disallow /images/2010/
Disallow /images/2011/
Disallow /images/2012/
Disallow /images/2013/
Disallow /images/2014/
Disallow /images/2015/
Disallow /images/2016/
Disallow /images/2017/01/
Disallow /images/2017/02/
Disallow /images/2017/03/
Disallow /images/2017/04/
Disallow /images/2017/05/
Disallow /images/2017/06/

googlebot-image

Rule Path
Disallow /

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.