businessnetworking.nz
robots.txt

Robots Exclusion Standard data for businessnetworking.nz

Resource Scan

Scan Details

Site Domain businessnetworking.nz
Base Domain businessnetworking.nz
Scan Status Ok
Last Scan2025-05-03T09:19:56+00:00
Next Scan 2025-06-02T09:19:56+00:00

Last Scan

Scanned2025-05-03T09:19:56+00:00
URL https://businessnetworking.nz/robots.txt
Redirect https://www.businessnetworking.nz/robots.txt
Redirect Domain www.businessnetworking.nz
Redirect Base businessnetworking.nz
Domain IPs 3.105.162.160
Redirect IPs 3.105.162.160
Response IP 3.105.162.160
Found Yes
Hash 6514840c59d66c944c929e298cda73510712b1a1d90e9efa9b20cb62df7a2666
SimHash 5be8eac4aa13

Groups

road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner

Rule Path
Disallow /webapps/

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

yandex

Rule Path
Disallow *.pdf
Disallow *.PDF

nlnz_iaharvester2024

Rule Path
Disallow /product/
Disallow /page/528976/shopping/cart/
Disallow /page/528976/shopping/productview/
Disallow /*?*
Disallow /*/productview/

*

Rule Path
Disallow /page/528976/shopping/cart/
Disallow /page/528976/shopping/productview/
Disallow /*?*b_id=
Disallow /*?*add2cart=
Disallow /*?*add2wishlist=
Disallow /*/shopping/cart/
Disallow /*shopping-basket
Disallow /*delete_basket
Disallow /*copyStyleFromCid%3D
Disallow /*new-website-contact.html
Disallow /webapps/templates
Disallow /webapps/templates/
Disallow /webapps/templates/track
Disallow /webapps/cms/
Disallow /webapps/cid/
Disallow /thumbs/
Disallow /img/
Disallow /templates/
Disallow /banners/
Disallow /Dictionary/
Disallow /_borders/
Disallow /_fpclass/
Disallow /_overlay/
Disallow /_private/
Disallow /_themes/
Disallow /cgi
Disallow /widgets/

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.businessnetworking.nz/sitemap.xml