lrft.co.nz
robots.txt
Robots Exclusion Standard data for lrft.co.nz
Resource Scan
Scan Details
| Site Domain | lrft.co.nz |
| Base Domain | lrft.co.nz |
| Scan Status | Ok |
| Last Scan | 2026-01-31T11:11:39+00:00 |
| Next Scan | 2026-03-02T11:11:39+00:00 |
Last Scan
| Scanned | 2026-01-31T11:11:39+00:00 |
| URL | https://lrft.co.nz/robots.txt |
| Redirect | https://www.lrft.co.nz/robots.txt |
| Redirect Domain | www.lrft.co.nz |
| Redirect Base | lrft.co.nz |
| Domain IPs | 54.79.101.34 |
| Redirect IPs | 54.79.101.34 |
| Response IP | 54.79.101.34 |
| Found | Yes |
| Hash | a3db6d22c8100f7441fdb64098257860c101533c38bfedcc2e5113b98d0ccabd |
| SimHash | 5be9eac4ae13 |
Groups
road runner: imagescape robot (lim@cs.leidenuniv.nl)
road runner: imagescape robot
roadrunner
| Rule | Path |
|---|---|
| Disallow | /webapps/ |
*
| Rule | Path |
|---|---|
| Disallow | /*?*b_id= |
| Disallow | /*?*add2cart= |
| Disallow | /*?*add2wishlist= |
| Disallow | /*/shopping/cart/ |
| Disallow | /*shopping-basket |
| Disallow | /*delete_basket |
| Disallow | /*copyStyleFromCid%3D |
| Disallow | /*new-website-contact.html |
| Disallow | /webapps/templates |
| Disallow | /webapps/templates/ |
| Disallow | /webapps/templates/track |
| Disallow | /webapps/cms/ |
| Disallow | /webapps/cid/ |
| Disallow | /thumbs/ |
| Disallow | /img/ |
| Disallow | /templates/ |
| Disallow | /banners/ |
| Disallow | /Dictionary/ |
| Disallow | /_borders/ |
| Disallow | /_fpclass/ |
| Disallow | /_overlay/ |
| Disallow | /_private/ |
| Disallow | /_themes/ |
| Disallow | /cgi |
| Disallow | /widgets/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lrft.co.nz/sitemap.xml |