getnewlook.co.nz
robots.txt

Robots Exclusion Standard data for getnewlook.co.nz

Resource Scan

Scan Details

Site Domain getnewlook.co.nz
Base Domain getnewlook.co.nz
Scan Status Ok
Last Scan2025-05-29T18:36:51+00:00
Next Scan 2025-06-28T18:36:51+00:00

Last Scan

Scanned2025-05-29T18:36:51+00:00
URL https://getnewlook.co.nz/robots.txt
Redirect https://www.getnewlook.co.nz/robots.txt
Redirect Domain www.getnewlook.co.nz
Redirect Base getnewlook.co.nz
Domain IPs 3.105.162.160
Redirect IPs 3.105.162.160
Response IP 3.105.162.160
Found Yes
Hash a7a4100a25345814a3718c0c1d96fe4bc4646577a857966ce01a38b791a2baf6
SimHash 5beb6ac4af93

Groups

road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner

Rule Path
Disallow /webapps/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

yandex

Rule Path
Disallow *.pdf
Disallow *.PDF

nlnz_iaharvester2024

Rule Path
Disallow /product/
Disallow /page/635821/shopping/cart/
Disallow /page/635821/shopping/productview/
Disallow /*?*
Disallow /*/productview/

*

Rule Path
Disallow /page/635821/shopping/cart/
Disallow /page/635821/shopping/productview/
Disallow /*?*b_id=
Disallow /*?*add2cart=
Disallow /*?*add2wishlist=
Disallow /*/shopping/cart/
Disallow /*shopping-basket
Disallow /*delete_basket
Disallow /*copyStyleFromCid%3D
Disallow /*new-website-contact.html
Disallow /webapps/templates
Disallow /webapps/templates/
Disallow /webapps/templates/track
Disallow /webapps/cms/
Disallow /webapps/cid/
Disallow /thumbs/
Disallow /img/
Disallow /templates/
Disallow /banners/
Disallow /Dictionary/
Disallow /_borders/
Disallow /_fpclass/
Disallow /_overlay/
Disallow /_private/
Disallow /_themes/
Disallow /cgi
Disallow /widgets/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.getnewlook.co.nz/sitemap.xml