nzfilterwarehouse.com
robots.txt

Robots Exclusion Standard data for nzfilterwarehouse.com

Resource Scan

Scan Details

Site Domain nzfilterwarehouse.com
Base Domain nzfilterwarehouse.com
Scan Status Ok
Last Scan2025-06-05T07:36:04+00:00
Next Scan 2025-07-05T07:36:04+00:00

Last Scan

Scanned2025-06-05T07:36:04+00:00
URL https://nzfilterwarehouse.com/robots.txt
Redirect https://www.nzfilterwarehouse.com/robots.txt
Redirect Domain www.nzfilterwarehouse.com
Redirect Base nzfilterwarehouse.com
Domain IPs 3.105.162.160
Redirect IPs 3.105.162.160
Response IP 3.105.162.160
Found Yes
Hash 9707c23025338bfe801957ce64d081aefb40bf01fd9a2d47b43bf05c3c44695e
SimHash 7be96ac0aa13

Groups

road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner

Rule Path
Disallow /webapps/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

yandex

Rule Path
Disallow *.pdf
Disallow *.PDF

nlnz_iaharvester2024

Rule Path
Disallow /product/
Disallow /page/100287/shopping/cart/
Disallow /page/100287/shopping/productview/
Disallow /*?*
Disallow /*/productview/

*

Rule Path
Disallow /page/100287/shopping/cart/
Disallow /page/100287/shopping/productview/
Disallow /*?*b_id=
Disallow /*?*add2cart=
Disallow /*?*add2wishlist=
Disallow /*/shopping/cart/
Disallow /*shopping-basket
Disallow /*delete_basket
Disallow /*copyStyleFromCid%3D
Disallow /*new-website-contact.html
Disallow /webapps/templates
Disallow /webapps/templates/
Disallow /webapps/templates/track
Disallow /webapps/cms/
Disallow /webapps/cid/
Disallow /thumbs/
Disallow /img/
Disallow /templates/
Disallow /banners/
Disallow /Dictionary/
Disallow /_borders/
Disallow /_fpclass/
Disallow /_overlay/
Disallow /_private/
Disallow /_themes/
Disallow /cgi
Disallow /widgets/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.nzfilterwarehouse.com/sitemap.xml