joelboehland.com
robots.txt

Robots Exclusion Standard data for joelboehland.com

Resource Scan

Scan Details

Site Domain joelboehland.com
Base Domain joelboehland.com
Scan Status Ok
Last Scan2024-05-17T15:56:53+00:00
Next Scan 2024-06-16T15:56:53+00:00

Last Scan

Scanned2024-05-17T15:56:53+00:00
URL https://www.joelboehland.com/robots.txt
Domain IPs 2600:9000:2003:1800:b:9fe0:20c0:93a1, 2600:9000:2003:1a00:b:9fe0:20c0:93a1, 2600:9000:2003:5800:b:9fe0:20c0:93a1, 2600:9000:2003:7c00:b:9fe0:20c0:93a1, 2600:9000:2003:8200:b:9fe0:20c0:93a1, 2600:9000:2003:c600:b:9fe0:20c0:93a1, 2600:9000:2003:ce00:b:9fe0:20c0:93a1, 2600:9000:2003:de00:b:9fe0:20c0:93a1, 52.84.229.61, 52.84.229.67, 52.84.229.83, 52.84.229.93
Response IP 52.84.229.93
Found Yes
Hash b25a2683d329e49c0e6cc8098a9f946f46920aaa7f47ada068ed44857cb01855
SimHash 08351d1b67c6

Groups

googlebot

Rule Path
Disallow

*

Rule Path
Disallow /ie6update/
Disallow /images/
Disallow /javascripts/
Disallow /css/

Comments

  • This file is used to allow search engine site crawlers to index this site.
  • Documentation on the robots.txt file: http://www.robotstxt.org/wc/norobots.html
  • List of all web robots: http://www.robotstxt.org/db.html
  • Check robots.txt at: http://tool.motoricerca.info/robots-checker.phtml
  • Details about Googlebot available at: http://www.google.com/bot.html
  • Googlebot
  • All
  • site specific