mbauckland.co.nz
robots.txt
Robots Exclusion Standard data for mbauckland.co.nz
Resource Scan
Scan Details
Site Domain | mbauckland.co.nz |
Base Domain | mbauckland.co.nz |
Scan Status | Ok |
Last Scan | 2024-09-15T06:19:46+00:00 |
Next Scan | 2024-10-15T06:19:46+00:00 |
Last Scan
Scanned | 2024-09-15T06:19:46+00:00 |
URL | https://www.mbauckland.co.nz/robots.txt |
Domain IPs | 125.56.219.18, 23.32.29.89, 2600:1413:b000:1b::17d7:716, 2600:1413:b000:1b::17d7:71b |
Response IP | 23.52.40.43 |
Found | Yes |
Hash | 03d1f8d9a24081ed298e8badaf1de8232c4888f9b3195fe6adf87bf8665b354c |
SimHash | 6009d810d7d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin |
Disallow | /account |
Disallow | /apps |
Disallow | /crx |
Disallow | /system |
Disallow | /libs |
Disallow | /content |
Allow | /content/dam/hq/brand-logo |
Allow | /content/*/mpc/* |
Disallow | /pab/ |
Disallow | /sec/js/ |
Disallow | /*.inc$ |
Disallow | /*.wmv$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.swf |
Disallow | /*/mobile/ |
Disallow | /*.popup.html$ |
Disallow | /etc |
Allow | /etc/clientlibs/acs-commons |
Allow | /etc.clientlibs |
Allow | /etc/designs/embxp-wholesale |
Disallow | *content-pool |
Allow | *content-pool/*.jpg |
Allow | *content-pool/*.png |
Allow | *content-pool/*.svg |
Allow | *content-pool/*.jpeg |
Allow | /vans/*/content-pool/apps |
Other Records
Field | Value |
---|---|
sitemap | https://www.mbauckland.co.nz/sitemaponeweb/sitemap.index.xml.gz |