webadvantage.co.nz
robots.txt
Robots Exclusion Standard data for webadvantage.co.nz
Resource Scan
Scan Details
| Site Domain | webadvantage.co.nz |
| Base Domain | webadvantage.co.nz |
| Scan Status | Ok |
| Last Scan | 2025-11-18T08:23:45+00:00 |
| Next Scan | 2025-12-18T08:23:45+00:00 |
Last Scan
| Scanned | 2025-11-18T08:23:45+00:00 |
| URL | https://webadvantage.co.nz/robots.txt |
| Redirect | https://www.webadvantage.co.nz/robots.txt |
| Redirect Domain | www.webadvantage.co.nz |
| Redirect Base | webadvantage.co.nz |
| Domain IPs | 54.79.101.34 |
| Redirect IPs | 154.26.158.147 |
| Response IP | 154.26.158.147 |
| Found | Yes |
| Hash | b7cb210a0157c3ada6f9063693cf0a72796cb07322c93e6751387de58503976c |
| SimHash | 5beb6ac4af17 |
Groups
road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner
| Rule | Path |
|---|---|
| Disallow | /webapps/ |
*
| Rule | Path |
|---|---|
| Disallow | /*?*b_id= |
| Disallow | /*?*add2cart= |
| Disallow | /*?*add2wishlist= |
| Disallow | /*/shopping/cart/ |
| Disallow | /*shopping-basket |
| Disallow | /*delete_basket |
| Disallow | /*copyStyleFromCid%3D |
| Disallow | /*new-website-contact.html |
| Disallow | /webapps/templates |
| Disallow | /webapps/templates/ |
| Disallow | /webapps/templates/track |
| Disallow | /webapps/cms/ |
| Disallow | /webapps/cid/ |
| Disallow | /thumbs/ |
| Disallow | /img/ |
| Disallow | /templates/ |
| Disallow | /banners/ |
| Disallow | /Dictionary/ |
| Disallow | /_borders/ |
| Disallow | /_fpclass/ |
| Disallow | /_overlay/ |
| Disallow | /_private/ |
| Disallow | /_themes/ |
| Disallow | /cgi |
| Disallow | /widgets/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.webadvantage.co.nz/sitemap.xml |