akbc.co.nz
robots.txt

Robots Exclusion Standard data for akbc.co.nz

Resource Scan

Scan Details

Site Domain akbc.co.nz
Base Domain akbc.co.nz
Scan Status Ok
Last Scan2025-05-24T09:56:52+00:00
Next Scan 2025-06-23T09:56:52+00:00

Last Scan

Scanned2025-05-24T09:56:52+00:00
URL https://akbc.co.nz/robots.txt
Redirect https://www.akbc.co.nz/robots.txt
Redirect Domain www.akbc.co.nz
Redirect Base akbc.co.nz
Domain IPs 3.105.162.160
Redirect IPs 3.105.162.160
Response IP 3.105.162.160
Found Yes
Hash cf57e8fca4c9ea6201507166f807c27dfdff44181f24eb40c02f0ce1b56f7f18
SimHash 73e9eac08e17

Groups

road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner

Rule Path
Disallow /webapps/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

yandex

Rule Path
Disallow *.pdf
Disallow *.PDF

nlnz_iaharvester2024

Rule Path
Disallow /product/
Disallow /page/591815/shopping/cart/
Disallow /page/591815/shopping/productview/
Disallow /*?*
Disallow /*/productview/

*

Rule Path
Disallow /page/591815/shopping/cart/
Disallow /page/591815/shopping/productview/
Disallow /*?*b_id=
Disallow /*?*add2cart=
Disallow /*?*add2wishlist=
Disallow /*/shopping/cart/
Disallow /*shopping-basket
Disallow /*delete_basket
Disallow /*copyStyleFromCid%3D
Disallow /*new-website-contact.html
Disallow /webapps/templates
Disallow /webapps/templates/
Disallow /webapps/templates/track
Disallow /webapps/cms/
Disallow /webapps/cid/
Disallow /thumbs/
Disallow /img/
Disallow /templates/
Disallow /banners/
Disallow /Dictionary/
Disallow /_borders/
Disallow /_fpclass/
Disallow /_overlay/
Disallow /_private/
Disallow /_themes/
Disallow /cgi
Disallow /widgets/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.akbc.co.nz/sitemap.xml