patternpostie.co.nz
robots.txt

Robots Exclusion Standard data for patternpostie.co.nz

Resource Scan

Scan Details

Site Domain patternpostie.co.nz
Base Domain patternpostie.co.nz
Scan Status Ok
Last Scan2025-10-04T16:08:14+00:00
Next Scan 2025-11-03T16:08:14+00:00

Last Scan

Scanned2025-10-04T16:08:14+00:00
URL https://patternpostie.co.nz/robots.txt
Redirect https://www.patternpostie.co.nz/robots.txt
Redirect Domain www.patternpostie.co.nz
Redirect Base patternpostie.co.nz
Domain IPs 103.121.35.72
Redirect IPs 154.26.158.147
Response IP 109.199.122.86
Found Yes
Hash 1bf476e1ee55ecfee70c18be70b7c4778b80658181ec322618e103e5cfa344bc
SimHash 7be96a40ee17

Groups

road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner

Rule Path
Disallow /webapps/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

yandex

Rule Path
Disallow *.pdf
Disallow *.PDF

nlnz_iaharvester2024

Rule Path
Disallow /product/
Disallow /page/287029/shopping/cart/
Disallow /page/287029/shopping/productview/
Disallow /*?*
Disallow /*/productview/

*

Rule Path
Disallow /page/287029/shopping/cart/
Disallow /page/287029/shopping/productview/
Disallow /*?*b_id=
Disallow /*?*add2cart=
Disallow /*?*add2wishlist=
Disallow /*/shopping/cart/
Disallow /*shopping-basket
Disallow /*delete_basket
Disallow /*copyStyleFromCid%3D
Disallow /*new-website-contact.html
Disallow /webapps/templates
Disallow /webapps/templates/
Disallow /webapps/templates/track
Disallow /webapps/cms/
Disallow /webapps/cid/
Disallow /thumbs/
Disallow /img/
Disallow /templates/
Disallow /banners/
Disallow /Dictionary/
Disallow /_borders/
Disallow /_fpclass/
Disallow /_overlay/
Disallow /_private/
Disallow /_themes/
Disallow /cgi
Disallow /widgets/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.patternpostie.co.nz/sitemap.xml