Log In Sign Up

head.com
robots.txt

Robots Exclusion Standard data for head.com

Resource Scan

Scan Details

Site Domain head.com
Base Domain head.com
Scan Status Ok
Last Scan2024-06-26T05:19:54+00:00
Next Scan 2024-07-26T05:19:54+00:00

Last Scan

Scanned2024-06-26T05:19:54+00:00
URL https://head.com/robots.txt
Redirect https://www.head.com/robots.txt
Redirect Domain www.head.com
Redirect Base head.com
Domain IPs 88.99.216.235
Redirect IPs 108.156.133.103, 108.156.133.51, 108.156.133.52, 108.156.133.62, 2600:9000:2755:4400:11:8285:f380:93a1, 2600:9000:2755:4800:11:8285:f380:93a1, 2600:9000:2755:7a00:11:8285:f380:93a1, 2600:9000:2755:8200:11:8285:f380:93a1, 2600:9000:2755:a000:11:8285:f380:93a1, 2600:9000:2755:b800:11:8285:f380:93a1, 2600:9000:2755:c00:11:8285:f380:93a1, 2600:9000:2755:c600:11:8285:f380:93a1
Response IP 108.156.133.62
Found Yes
Hash e008ee5cd7bc9fa5362a7a23d2cb7018b8ed663223148cced139c460671b29a9
SimHash 0c17fe958ec8

Groups

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /404/
Disallow /app/
Disallow /cgi-bin/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /js/
Disallow /lib/
Disallow /magento/
Disallow /media/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /skin/
Disallow /stats/
Disallow /var/
Disallow /index.php
Disallow /*/index.php
Disallow /*/catalog/product_compare/
Disallow /*/catalog/category/view/
Disallow /*/catalog/product/view/
Disallow /*/catalogsearch/
Disallow /*/checkout/
Disallow /*/control/
Disallow /*/contacts/
Disallow /*/customer/
Disallow /*/customize/
Disallow /*/newsletter/
Disallow /*/poll/
Disallow /*/review/
Disallow /*/sendfriend/
Disallow /*/tag/
Disallow /*/wishlist/
Disallow /*/catalog/product/gallery/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /*?SID=
Disallow /*/crmpage$
Disallow /*/crmpage?*
Disallow /pl_PL/szkolenieracing
Disallow /*/head-padel-collection-2025
Disallow /*/head-tennis-collection-2025
Disallow /*/form-1-test
Disallow /*/form-1-live
Back to top

Other Records

Field Value
sitemap https://www.head.com/media/sitemap_head_en.xml
sitemap https://www.head.com/media/sitemap_head_fr_CA.xml
sitemap https://www.head.com/media/sitemap_head_en_CA.xml
sitemap https://www.head.com/media/sitemap_head_en_SE.xml
sitemap https://www.head.com/media/sitemap_head_es_ES.xml
sitemap https://www.head.com/media/sitemap_head_en_SL.xml
sitemap https://www.head.com/media/sitemap_head_en_SK.xml
sitemap https://www.head.com/media/sitemap_head_en_RO.xml
sitemap https://www.head.com/media/sitemap_head_en_PT.xml
sitemap https://www.head.com/media/sitemap_head_en_NO.xml
sitemap https://www.head.com/media/sitemap_head_nl_NL.xml
sitemap https://www.head.com/media/sitemap_head_fr_MC.xml
sitemap https://www.head.com/media/sitemap_head_en_MT.xml
sitemap https://www.head.com/media/sitemap_head_fr_LU.xml
sitemap https://www.head.com/media/sitemap_head_en_LT.xml
sitemap https://www.head.com/media/sitemap_head_de_LI.xml
sitemap https://www.head.com/media/sitemap_head_en_LV.xml
sitemap https://www.head.com/media/sitemap_head_ja_JP.xml
sitemap https://www.head.com/media/sitemap_head_en_IE.xml
sitemap https://www.head.com/media/sitemap_head_en_HU.xml
sitemap https://www.head.com/media/sitemap_head_en_GR.xml
sitemap https://www.head.com/media/sitemap_head_fr_FR.xml
sitemap https://www.head.com/media/sitemap_head_en_FI.xml
sitemap https://www.head.com/media/sitemap_head_pl_PL.xml
sitemap https://www.head.com/media/sitemap_head_en_EE.xml
sitemap https://www.head.com/media/sitemap_head_en_DK.xml
sitemap https://www.head.com/media/sitemap_head_cs_CZ.xml
sitemap https://www.head.com/media/sitemap_head_en_CY.xml
sitemap https://www.head.com/media/sitemap_head_en_HR.xml
sitemap https://www.head.com/media/sitemap_head_en_BG.xml
sitemap https://www.head.com/media/sitemap_head_fr_BE.xml
sitemap https://www.head.com/media/sitemap_head_it_CH.xml
sitemap https://www.head.com/media/sitemap_head_fr_CH.xml
sitemap https://www.head.com/media/sitemap_head_it_IT.xml
sitemap https://www.head.com/media/sitemap_head_en_GB.xml
sitemap https://www.head.com/media/sitemap_head_en_US.xml
sitemap https://www.head.com/media/sitemap_head_de_CH.xml
sitemap https://www.head.com/media/sitemap_head_de_DE.xml
sitemap https://www.head.com/media/sitemap_head_de_AT.xml
sitemap https://www.head.com/media/blog_sitemap_head_en.xml
sitemap https://www.head.com/media/blog_sitemap_head_fr_CA.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_CA.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_SE.xml
sitemap https://www.head.com/media/blog_sitemap_head_es_ES.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_SL.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_SK.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_RO.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_PT.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_NO.xml
sitemap https://www.head.com/media/blog_sitemap_head_nl_NL.xml
sitemap https://www.head.com/media/blog_sitemap_head_fr_MC.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_MT.xml
sitemap https://www.head.com/media/blog_sitemap_head_fr_LU.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_LT.xml
sitemap https://www.head.com/media/blog_sitemap_head_de_LI.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_LV.xml
sitemap https://www.head.com/media/blog_sitemap_head_ja_JP.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_IE.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_HU.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_GR.xml
sitemap https://www.head.com/media/blog_sitemap_head_fr_FR.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_FI.xml
sitemap https://www.head.com/media/blog_sitemap_head_pl_PL.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_EE.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_DK.xml
sitemap https://www.head.com/media/blog_sitemap_head_cs_CZ.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_CY.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_HR.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_BG.xml
sitemap https://www.head.com/media/blog_sitemap_head_fr_BE.xml
sitemap https://www.head.com/media/blog_sitemap_head_it_CH.xml
sitemap https://www.head.com/media/blog_sitemap_head_fr_CH.xml
sitemap https://www.head.com/media/blog_sitemap_head_it_IT.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_GB.xml
sitemap https://www.head.com/media/blog_sitemap_head_en_US.xml
sitemap https://www.head.com/media/blog_sitemap_head_de_CH.xml
sitemap https://www.head.com/media/blog_sitemap_head_de_DE.xml
sitemap https://www.head.com/media/blog_sitemap_head_de_AT.xml
Back to top

Comments

  • google image crawler setup
  • crawlers setup
  • directories
  • paths (clean urls)
  • files
  • scripts
  • temporary blocks
  • whole domain multistore site maps
  • blog feature dedicated sitemaps
  • strict lock of some of the magento pages
Back to top