businessnetworking.nz
robots.txt
Robots Exclusion Standard data for businessnetworking.nz
Resource Scan
Scan Details
Site Domain | businessnetworking.nz |
Base Domain | businessnetworking.nz |
Scan Status | Ok |
Last Scan | 2025-05-03T09:19:56+00:00 |
Next Scan | 2025-06-02T09:19:56+00:00 |
Last Scan
Scanned | 2025-05-03T09:19:56+00:00 |
URL | https://businessnetworking.nz/robots.txt |
Redirect | https://www.businessnetworking.nz/robots.txt |
Redirect Domain | www.businessnetworking.nz |
Redirect Base | businessnetworking.nz |
Domain IPs | 3.105.162.160 |
Redirect IPs | 3.105.162.160 |
Response IP | 3.105.162.160 |
Found | Yes |
Hash | 6514840c59d66c944c929e298cda73510712b1a1d90e9efa9b20cb62df7a2666 |
SimHash | 5be8eac4aa13 |
Groups
road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner
Rule | Path |
---|---|
Disallow | /webapps/ |
nlnz_iaharvester2024
Rule | Path |
---|---|
Disallow | /product/ |
Disallow | /page/528976/shopping/cart/ |
Disallow | /page/528976/shopping/productview/ |
Disallow | /*?* |
Disallow | /*/productview/ |
*
Rule | Path |
---|---|
Disallow | /page/528976/shopping/cart/ |
Disallow | /page/528976/shopping/productview/ |
Disallow | /*?*b_id= |
Disallow | /*?*add2cart= |
Disallow | /*?*add2wishlist= |
Disallow | /*/shopping/cart/ |
Disallow | /*shopping-basket |
Disallow | /*delete_basket |
Disallow | /*copyStyleFromCid%3D |
Disallow | /*new-website-contact.html |
Disallow | /webapps/templates |
Disallow | /webapps/templates/ |
Disallow | /webapps/templates/track |
Disallow | /webapps/cms/ |
Disallow | /webapps/cid/ |
Disallow | /thumbs/ |
Disallow | /img/ |
Disallow | /templates/ |
Disallow | /banners/ |
Disallow | /Dictionary/ |
Disallow | /_borders/ |
Disallow | /_fpclass/ |
Disallow | /_overlay/ |
Disallow | /_private/ |
Disallow | /_themes/ |
Disallow | /cgi |
Disallow | /widgets/ |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Other Records
Field | Value |
---|---|
sitemap | https://www.businessnetworking.nz/sitemap.xml |