conns.com
robots.txt

Robots Exclusion Standard data for conns.com

Resource Scan

Scan Details

Site Domain conns.com
Base Domain conns.com
Scan Status Ok
Last Scan2024-09-05T08:21:56+00:00
Next Scan 2024-10-05T08:21:56+00:00

Last Scan

Scanned2024-09-05T08:21:56+00:00
URL https://conns.com/robots.txt
Redirect https://www.conns.com/robots.txt
Redirect Domain www.conns.com
Redirect Base conns.com
Domain IPs 63.141.128.20
Redirect IPs 63.141.128.20
Response IP 63.141.128.20
Found Yes
Hash ce4a557d174d1c775c7c4b7f5d0d8f89736b93e36c78a97ba47c5c56b10b4683
SimHash 3d08f87642d9

Groups

*

Rule Path
Disallow /?_bc_fsnf=1
Disallow /%26_bc_fsnf%3D1
Disallow /account.php
Disallow /cart.php
Disallow /catalogsearch/
Disallow /checkout.php
Disallow /checkout
Disallow /checkout/cart*
Disallow /finishorder.php
Disallow /login.php*
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php*
Disallow /viewfile.php
Disallow /wishlist.php*
Disallow /admin/
Disallow /__socialshop/
Disallow /write-a-review
Disallow /add-ons/
Disallow /add-ons/*

googlebot

Rule Path
Disallow /?_bc_fsnf=1
Disallow /%26_bc_fsnf%3D1
Disallow /account.php
Disallow /cart.php
Disallow /catalogsearch/
Disallow /checkout.php
Disallow /checkout
Disallow /checkout/cart*
Disallow /finishorder.php
Disallow /login.php*
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php*
Disallow /viewfile.php
Disallow /wishlist.php*
Disallow /admin
Disallow /__socialshop/
Disallow /?dir=
Disallow /?mode
Disallow /write-a-review

adsbot-google

Rule Path
Disallow /?_bc_fsnf=1
Disallow /%26_bc_fsnf%3D1
Disallow /account.php
Disallow /cart.php
Disallow /catalogsearch/
Disallow /checkout.php
Disallow /checkout
Disallow /checkout/cart*
Disallow /finishorder.php
Disallow /login.php*
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php*
Disallow /viewfile.php
Disallow /wishlist.php*
Disallow /admin
Disallow /__socialshop/
Disallow /?dir=
Disallow /?mode
Disallow /write-a-review

googlebot-image

Rule Path
Disallow /?_bc_fsnf=1
Disallow /%26_bc_fsnf%3D1
Disallow /account.php
Disallow /cart.php
Disallow /checkout/cart*
Disallow /catalogsearch/
Disallow /checkout.php
Disallow /checkout
Disallow /checkout/cart*
Disallow /finishorder.php
Disallow /login.php
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php*
Disallow /viewfile.php
Disallow /wishlist.php*
Disallow /admin
Disallow /__socialshop/
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /auth.json.sample
Disallow /CHANGELOG.md
Disallow /grunt-config.json.sample
Disallow /Gruntfile.js.sample
Disallow /index.php
Disallow /indextest.html
Disallow /indextest-asg.html
Disallow /composer.json
Disallow /composer.lock
Disallow /COPYING.txt
Disallow /LICENSE_EE.txt
Disallow /package.json.sample
Disallow /README_EE.md
Disallow /testuat-asg.php
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /php.ini.sample
Disallow /connsmedia-rsync.sh
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalogsearch/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /tag/
Disallow /conns_admin/
Disallow /review/product/
Disallow /404/
Disallow /poll/
Disallow /invitation/
Disallow /downloadable/
Disallow /customer_order/
Disallow /vault/
Disallow /giftcard/
Disallow /paypal/billing_agreement/
Disallow /giftregistry/
Disallow /?dir
Disallow /?dir=desc
Disallow /?dir=asc
Disallow /?limit=all
Disallow /?mode*
Disallow /.CVS
Disallow /.Zip$
Disallow /.Svn$
Disallow /.Idea$
Disallow /.Sql$
Disallow /.Tgz$

duckduckbot

Rule Path
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /auth.json.sample
Disallow /CHANGELOG.md
Disallow /grunt-config.json.sample
Disallow /Gruntfile.js.sample
Disallow /index.php
Disallow /indextest.html
Disallow /indextest-asg.html
Disallow /composer.json
Disallow /composer.lock
Disallow /COPYING.txt
Disallow /LICENSE_EE.txt
Disallow /package.json.sample
Disallow /README_EE.md
Disallow /testuat-asg.php
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /php.ini.sample
Disallow /connsmedia-rsync.sh
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalogsearch/
Disallow /checkout/cart*
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /tag/
Disallow /conns_admin/
Disallow /review/product/
Disallow /404/
Disallow /poll/
Disallow /invitation/
Disallow /downloadable/
Disallow /customer_order/
Disallow /vault/
Disallow /giftcard/
Disallow /paypal/billing_agreement/
Disallow /giftregistry/
Disallow /?dir=
Disallow /?dir=desc
Disallow /?dir=asc
Disallow /?limit=all
Disallow /?mode*
Disallow /.CVS
Disallow /.Zip$
Disallow /.Svn$
Disallow /.Idea$
Disallow /.Sql$
Disallow /.Tgz$
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /auth.json.sample
Disallow /CHANGELOG.md
Disallow /grunt-config.json.sample
Disallow /Gruntfile.js.sample
Disallow /index.php
Disallow /indextest.html
Disallow /indextest-asg.html
Disallow /composer.json
Disallow /composer.lock
Disallow /COPYING.txt
Disallow /LICENSE_EE.txt
Disallow /package.json.sample
Disallow /README_EE.md
Disallow /testuat-asg.php
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /php.ini.sample
Disallow /connsmedia-rsync.sh
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalogsearch/
Disallow /checkout
Disallow /checkout/cart*
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /tag/
Disallow /conns_admin/
Disallow /review/product/
Disallow /404/
Disallow /poll/
Disallow /invitation/
Disallow /downloadable/
Disallow /customer_order/
Disallow /vault/
Disallow /giftcard/
Disallow /paypal/billing_agreement/
Disallow /giftregistry/
Disallow /store-closings/
Disallow /store-closings-conns/
Disallow /?dir=
Disallow /?dir=desc
Disallow /?dir=asc
Disallow /?limit=all
Disallow /?mode*
Disallow /.CVS
Disallow /.Zip$
Disallow /.Svn$
Disallow /.Idea$
Disallow /.Sql$
Disallow /.Tgz$

Other Records

Field Value
crawl-delay 10
crawl-delay 10

yandexbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

versafeedbot

Rule Path
Disallow /

google-xrawler

Rule Path
Allow /feeds/*

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*

Other Records

Field Value
sitemap https://www.conns.com/xmlsitemap.php
sitemap https://www.conns.com/sitemap.php
sitemap https://www.conns.com/content/spanish_sitemap/brands.xml
sitemap https://www.conns.com/content/spanish_sitemap/pages.xml
sitemap https://www.conns.com/content/spanish_sitemap/products.xml
sitemap https://www.conns.com/content/spanish_sitemap/categories.xml
sitemap https://www.conns.com/content/spanish_sitemap/news.xml

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Do not index pages that are sorted or filtered.
  • Do not index session ID
  • Disallow: /SID=
  • Disallow: /?SID=
  • Disallow: /*.php$
  • CVS, SVN directory and dump files
  • Directories
  • Files
  • Paths (clean URLs)
  • Do not index pages that are sorted or filtered.
  • Do not index session ID
  • Disallow: /SID=
  • Disallow: /?SID=
  • Disallow: /*.php$
  • CVS, SVN directory and dump files
  • User-agent: AhrefsBot
  • Directories
  • Files
  • Paths (clean URLs)
  • Do not index pages that are sorted or filtered.
  • Do not index session ID
  • Disallow: /SID=
  • Disallow: /?SID=
  • Disallow: /*.php$
  • CVS, SVN directory and dump files