amphenol-cs.com
robots.txt

Robots Exclusion Standard data for amphenol-cs.com

Resource Scan

Scan Details

Site Domain amphenol-cs.com
Base Domain amphenol-cs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-14T10:17:55+00:00
Next Scan 2026-01-12T10:17:55+00:00

Last Successful Scan

Scanned2025-05-25T06:25:09+00:00
URL https://amphenol-cs.com/robots.txt
Redirect https://www.amphenol-cs.com/robots.txt
Redirect Domain www.amphenol-cs.com
Redirect Base amphenol-cs.com
Domain IPs 104.18.28.250, 104.18.29.250, 2606:4700::6812:1cfa, 2606:4700::6812:1dfa
Redirect IPs 104.18.28.250, 104.18.29.250, 2606:4700::6812:1cfa, 2606:4700::6812:1dfa
Response IP 104.18.28.250
Found Yes
Hash fb05230c8057b3c0eeb5b435cbea6c87ee4281a1a5c17d3ffb932882f5db7f13
SimHash 4214dc52cb02

Groups

*

Rule Path
Disallow /index.php/
Disallow /wishlist/
Disallow /admin/
Disallow /backoffice/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /*.php
Disallow /*.md
Disallow /*.sample
Disallow /*.json
Disallow /*.lock
Disallow /*.sh
Disallow /*.zip
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /media/wysiwyg/files/general-internal/
Disallow /_shell/
Disallow /var/
Disallow /media/coc/
Disallow /compliance/certificate/
Disallow /centreon-monitoring-tool-do-not-touch
Disallow /cache-warmer-do-not-touch
Disallow /tag/
Disallow /rewiew/
Disallow /catalogsearch/result/?*
Disallow /content/search/?*
Disallow /change-request-form

rogerbot

Rule Path
Disallow /*?*
Disallow /*.html?*
Disallow /index.php/
Disallow /wishlist/
Disallow /admin/
Disallow /backoffice/
Disallow /review/product/
Disallow /sendfriend/
Disallow /enable-cookies/
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /*.php
Disallow /*.md
Disallow /*.sample
Disallow /*.json
Disallow /*.lock
Disallow /*.sh
Disallow /*.zip
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/
Disallow /media/wysiwyg/files/general-internal/
Disallow /media/wysiwyg/files/
Disallow /_shell/
Disallow /var/
Disallow /media/coc/
Disallow /compliance/certificate/
Disallow /tag/
Disallow /rewiew/
Disallow /new-home/
Disallow /customproduct*
Disallow

Other Records

Field Value
crawl-delay 10

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.amphenol-cs.com/sitemap.xml

Comments

  • Stop crawling user account and checkout pages by search engine robot:
  • Blocking native catalog and search pages:
  • Sometimes Webmasters block pages with filters..
  • Blocking CMS directories.
  • Blocking CMS Pages
  • Blocking duplicate content:
  • Block filters:
  • Disallow: /*?*
  • Disallow: /*.html?*
  • Stop crawling change request form url
  • Block Crawlers

Warnings

  • `host` is not a known field.