webfoot.nz
robots.txt
Robots Exclusion Standard data for webfoot.nz
Resource Scan
Scan Details
| Site Domain | webfoot.nz |
| Base Domain | webfoot.nz |
| Scan Status | Ok |
| Last Scan | 2025-12-26T00:59:59+00:00 |
| Next Scan | 2026-01-02T00:59:59+00:00 |
Last Scan
| Scanned | 2025-12-26T00:59:59+00:00 |
| URL | https://webfoot.nz/robots.txt |
| Redirect | https://www.webfoot.nz/robots.txt |
| Redirect Domain | www.webfoot.nz |
| Redirect Base | webfoot.nz |
| Domain IPs | 103.121.35.72 |
| Redirect IPs | 154.26.158.147 |
| Response IP | 154.26.158.147 |
| Found | Yes |
| Hash | da21827c9c714d9805023bf84d3d4c6f24539b154b43b3750184f0fe10a5699c |
| SimHash | d9e96ac0ae17 |
Groups
road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner
| Rule | Path |
|---|---|
| Disallow | /webapps/ |
nlnz_iaharvester2024
| Rule | Path |
|---|---|
| Disallow | /product/ |
| Disallow | /page/529135/shopping/cart/ |
| Disallow | /page/529135/shopping/productview/ |
| Disallow | /page/529134/shopping/cart/ |
| Disallow | /page/529134/shopping/productview/ |
| Disallow | /*?* |
| Disallow | /*/productview/ |
*
| Rule | Path |
|---|---|
| Disallow | /page/529135/shopping/cart/ |
| Disallow | /page/529135/shopping/productview/ |
| Disallow | /page/529134/shopping/cart/ |
| Disallow | /page/529134/shopping/productview/ |
| Disallow | /*?*b_id= |
| Disallow | /*?*add2cart= |
| Disallow | /*?*add2wishlist= |
| Disallow | /*/shopping/cart/ |
| Disallow | /*shopping-basket |
| Disallow | /*delete_basket |
| Disallow | /*copyStyleFromCid%3D |
| Disallow | /*new-website-contact.html |
| Disallow | /webapps/templates |
| Disallow | /webapps/templates/ |
| Disallow | /webapps/templates/track |
| Disallow | /webapps/cms/ |
| Disallow | /webapps/cid/ |
| Disallow | /thumbs/ |
| Disallow | /img/ |
| Disallow | /templates/ |
| Disallow | /banners/ |
| Disallow | /Dictionary/ |
| Disallow | /_borders/ |
| Disallow | /_fpclass/ |
| Disallow | /_overlay/ |
| Disallow | /_private/ |
| Disallow | /_themes/ |
| Disallow | /cgi |
| Disallow | /widgets/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.webfoot.nz/sitemap.xml |