joelboehland.com
robots.txt

Robots Exclusion Standard data for joelboehland.com

Resource Scan

Scan Details

Site Domain joelboehland.com
Base Domain joelboehland.com
Scan Status Ok
Last Scan2024-11-13T15:58:42+00:00
Next Scan 2024-12-13T15:58:42+00:00

Last Scan

Scanned2024-11-13T15:58:42+00:00
URL https://www.joelboehland.com/robots.txt
Domain IPs 18.155.68.120, 18.155.68.26, 18.155.68.44, 18.155.68.72, 2600:9000:23d2:1000:b:9fe0:20c0:93a1, 2600:9000:23d2:2800:b:9fe0:20c0:93a1, 2600:9000:23d2:4400:b:9fe0:20c0:93a1, 2600:9000:23d2:9600:b:9fe0:20c0:93a1, 2600:9000:23d2:9a00:b:9fe0:20c0:93a1, 2600:9000:23d2:e00:b:9fe0:20c0:93a1, 2600:9000:23d2:ec00:b:9fe0:20c0:93a1, 2600:9000:23d2:f200:b:9fe0:20c0:93a1
Response IP 18.155.68.26
Found Yes
Hash b25a2683d329e49c0e6cc8098a9f946f46920aaa7f47ada068ed44857cb01855
SimHash 08351d1b67c6

Groups

googlebot

Rule Path
Disallow

*

Rule Path
Disallow /ie6update/
Disallow /images/
Disallow /javascripts/
Disallow /css/

Comments

  • This file is used to allow search engine site crawlers to index this site.
  • Documentation on the robots.txt file: http://www.robotstxt.org/wc/norobots.html
  • List of all web robots: http://www.robotstxt.org/db.html
  • Check robots.txt at: http://tool.motoricerca.info/robots-checker.phtml
  • Details about Googlebot available at: http://www.google.com/bot.html
  • Googlebot
  • All
  • site specific