akbc.co.nz
robots.txt
Robots Exclusion Standard data for akbc.co.nz
Resource Scan
Scan Details
Site Domain | akbc.co.nz |
Base Domain | akbc.co.nz |
Scan Status | Ok |
Last Scan | 2025-05-24T09:56:52+00:00 |
Next Scan | 2025-06-23T09:56:52+00:00 |
Last Scan
Scanned | 2025-05-24T09:56:52+00:00 |
URL | https://akbc.co.nz/robots.txt |
Redirect | https://www.akbc.co.nz/robots.txt |
Redirect Domain | www.akbc.co.nz |
Redirect Base | akbc.co.nz |
Domain IPs | 3.105.162.160 |
Redirect IPs | 3.105.162.160 |
Response IP | 3.105.162.160 |
Found | Yes |
Hash | cf57e8fca4c9ea6201507166f807c27dfdff44181f24eb40c02f0ce1b56f7f18 |
SimHash | 73e9eac08e17 |
Groups
road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner
Rule | Path |
---|---|
Disallow | /webapps/ |
nlnz_iaharvester2024
Rule | Path |
---|---|
Disallow | /product/ |
Disallow | /page/591815/shopping/cart/ |
Disallow | /page/591815/shopping/productview/ |
Disallow | /*?* |
Disallow | /*/productview/ |
*
Rule | Path |
---|---|
Disallow | /page/591815/shopping/cart/ |
Disallow | /page/591815/shopping/productview/ |
Disallow | /*?*b_id= |
Disallow | /*?*add2cart= |
Disallow | /*?*add2wishlist= |
Disallow | /*/shopping/cart/ |
Disallow | /*shopping-basket |
Disallow | /*delete_basket |
Disallow | /*copyStyleFromCid%3D |
Disallow | /*new-website-contact.html |
Disallow | /webapps/templates |
Disallow | /webapps/templates/ |
Disallow | /webapps/templates/track |
Disallow | /webapps/cms/ |
Disallow | /webapps/cid/ |
Disallow | /thumbs/ |
Disallow | /img/ |
Disallow | /templates/ |
Disallow | /banners/ |
Disallow | /Dictionary/ |
Disallow | /_borders/ |
Disallow | /_fpclass/ |
Disallow | /_overlay/ |
Disallow | /_private/ |
Disallow | /_themes/ |
Disallow | /cgi |
Disallow | /widgets/ |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Other Records
Field | Value |
---|---|
sitemap | https://www.akbc.co.nz/sitemap.xml |