autoupgrades.co.nz
robots.txt

Robots Exclusion Standard data for autoupgrades.co.nz

Resource Scan

Scan Details

Site Domain autoupgrades.co.nz
Base Domain autoupgrades.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-25T07:02:04+00:00
Next Scan 2026-01-23T07:02:04+00:00

Last Successful Scan

Scanned2023-06-15T17:55:07+00:00
URL https://autoupgrades.co.nz/robots.txt
Redirect https://www.autoupgrades.co.nz/robots.txt
Redirect Domain www.autoupgrades.co.nz
Redirect Base autoupgrades.co.nz
Domain IPs 104.21.12.153, 172.67.132.44, 2606:4700:3033::6815:c99, 2606:4700:3034::ac43:842c
Redirect IPs 54.206.136.98
Response IP 54.206.136.98
Found Yes
Hash 0d3e0281b8344729773068c9f4706a7997719cccfe3acb428cf3b4ba5de247fd
SimHash 8c0d1851c3f1

Groups

*
googlebot

Rule Path
Allow /*?p=
Allow /blog
Disallow /small_image
Disallow /404/
Disallow /app
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /magento/
Disallow /shell/
Disallow /var/
Disallow /customer/account/login
Disallow /customer/account
Disallow /customer
Disallow /main
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/product/upload
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /catalogsearch/result/
Disallow /catalogsearch/advanced/
Disallow /catalogsearch/advanced/result/
Disallow /checkout/
Disallow /checkout/cart/
Disallow /checkout/onepage/
Disallow /control/
Disallow /contacts/
Disallow /contacts/index/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /mercedes-1.html
Disallow /ford-1.html
Disallow /bugatti-1.html
Disallow /honda-1.html
Disallow /volvo-1.html
Disallow /smotor.html
Disallow /volvo-1.html
Disallow /bugatti-1.html
Disallow /aml.html
Disallow /daimler-benz.html
Disallow /catalogsearch/
Disallow /testing.html
Disallow /testing-2.html
Disallow /testing2.html
Disallow /main
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /RELEASE_NOTES.txt
Disallow /package.xml
Disallow /modman
Disallow /mage
Disallow /index.php.sample
Disallow /php.ini.sample
Disallow /get.php
Disallow /composer.json
Disallow /ch-viewopcache.php
Disallow /ch-resetopcache.php
Disallow /api.php
Disallow /.htaccess.sample
Disallow /*.js$
Disallow /*.css$
Disallow /*.php$
Disallow /*?p=*&
Disallow /*?SID=
Disallow /vag-html.html

googlebot

Rule Path
Allow /media/

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.autoupgrades.co.nz/sitemap.xml

Comments

  • Crawlers Setup
  • Allowable Index
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)
  • Allow