joineryhardware.co.nz
robots.txt
Robots Exclusion Standard data for joineryhardware.co.nz
Resource Scan
Scan Details
Site Domain | joineryhardware.co.nz |
Base Domain | joineryhardware.co.nz |
Scan Status | Ok |
Last Scan | 2024-09-24T01:30:27+00:00 |
Next Scan | 2024-10-24T01:30:27+00:00 |
Last Scan
Scanned | 2024-09-24T01:30:27+00:00 |
URL | https://joineryhardware.co.nz/robots.txt |
Redirect | https://www.joineryhardware.co.nz/robots.txt |
Redirect Domain | www.joineryhardware.co.nz |
Redirect Base | joineryhardware.co.nz |
Domain IPs | 223.165.77.175 |
Redirect IPs | 223.165.77.175 |
Response IP | 223.165.77.175 |
Found | Yes |
Hash | 62fbcc7431d3591f62fa124d37d9e7c8d6957cd4fdeb1c62cdc625ec73d1de86 |
SimHash | 702193d3c5e7 |
Groups
msnbot
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /config/ |
Disallow | /fwd/ |
Disallow | /inc/ |
Disallow | /lib/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /stats/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
slurp
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /config/ |
Disallow | /fwd/ |
Disallow | /inc/ |
Disallow | /lib/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /stats/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
yahoo-newscrawler
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /config/ |
Disallow | /fwd/ |
Disallow | /inc/ |
Disallow | /lib/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /stats/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
googlebot
googlebot-pm
sensis
newsexpress
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /config/ |
Disallow | /fwd/ |
Disallow | /inc/ |
Disallow | /lib/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /stats/ |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /config/ |
Disallow | /fwd/ |
Disallow | /inc/ |
Disallow | /lib/ |
Disallow | /logs/ |
Disallow | /modules/ |
Disallow | /stats/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.joineryhardware.co.nz/sitemap.xml |
Warnings
- 44 invalid lines.
Comments