Log In Sign Up

championperformance.com
robots.txt

Robots Exclusion Standard data for championperformance.com

Resource Scan

Scan Details

Site Domain championperformance.com
Base Domain championperformance.com
Scan Status Ok
Last Scan2024-11-06T03:28:38+00:00
Next Scan 2024-12-06T03:28:38+00:00

Last Scan

Scanned2024-11-06T03:28:38+00:00
URL https://championperformance.com/robots.txt
Domain IPs 13.33.88.44, 13.33.88.45, 13.33.88.53, 13.33.88.76
Response IP 13.33.88.76
Found Yes
Hash f626ab54f82c11f5e64eb3b18fa495e85ccca7f630df9f5340cba5b1782e79d1
SimHash 0021fb718ce3

Groups

scoutjet

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

gocrawl

Rule Path
Disallow /

bubing

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

msie8

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bing

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

cfnetwork

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

dalvik

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /ASPDNSFCommon/
Disallow /ASPDNSFEncrypt/
Disallow /ASPDNSFGateways/
Disallow /ASPDNSFPatterns/
Disallow /ASPDNSFQuickBooks/
Disallow /bin/
Disallow /categorydescriptions/
Disallow /db/
Disallow /download/
Disallow /emailtemplates/
Disallow /images/
Disallow /orderdownloads/
Disallow /productdescriptions/
Disallow /productspecs/
Disallow /receipts/
Disallow /remotetracer/
Disallow /sectiondescriptions/
Disallow /shipped/
Disallow /skins/
Disallow /subscription/
Disallow /URLRewriter/
Disallow /XMLImporter/
Disallow /*selection
Disallow /*sortby
Disallow /landing/
Disallow /sendfriend/
Disallow /reviewdetail/
Disallow /CVS
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /admin/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /*?Dir*
Disallow /*?Dir=desc
Disallow /*?Dir=asc
Disallow /*?Limit=all
Disallow /*?Mode*
Disallow /*?SID=
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Back to top

Comments

  • Magento sitemap: URL to your sitemap file in Magento
  • Robots.txt for Magento Community and Enterprise
  • Settings that relate to the UNDER CONSTRUCTION
  • Do not allow indexing files and folders that are required during development: CVS, SVN directory and dump files
  • GENERAL SETTINGS For MAGENTO
  • Do not index the page Magento admin
  • Do not index the general technical Magento directory
  • Do not index the shared files Magento
  • MAGENTO SEA IMPROVEMENT
  • Do not index the page subcategories that are sorted or filtered.
  • Do not index the second copy of the home page (example.com / index.php /). Un-comment only if you have activated Magento SEO URLs.
  • Disallow: /index.php/
  • Do not index the link from the session ID
  • Do not index the page checkout and user account
Back to top