mbmelbourne.com.au
robots.txt
Robots Exclusion Standard data for mbmelbourne.com.au
Resource Scan
Scan Details
Site Domain | mbmelbourne.com.au |
Base Domain | mbmelbourne.com.au |
Scan Status | Ok |
Last Scan | 2024-09-13T12:29:49+00:00 |
Next Scan | 2024-10-13T12:29:49+00:00 |
Last Scan
Scanned | 2024-09-13T12:29:49+00:00 |
URL | https://www.mbmelbourne.com.au/robots.txt |
Domain IPs | 125.56.219.18, 23.32.29.89, 2600:1413:b000:1b::17d7:716, 2600:1413:b000:1b::17d7:71b |
Response IP | 23.52.40.43 |
Found | Yes |
Hash | 01ab01eb781a369fcf1d06e115d3912095d6db86a3acb3f99860cac14115be6e |
SimHash | 6009d814d353 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin |
Disallow | /account |
Disallow | /apps |
Disallow | /crx |
Disallow | /system |
Disallow | /libs |
Disallow | /content |
Allow | /content/dam/hq/brand-logo |
Allow | /content/*/mpc/* |
Disallow | /pab/ |
Disallow | /sec/js/ |
Disallow | /*.inc$ |
Disallow | /*.wmv$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.swf |
Disallow | /*/mobile/ |
Disallow | /*.popup.html$ |
Disallow | /etc |
Allow | /etc/clientlibs/acs-commons |
Allow | /etc.clientlibs |
Allow | /etc/designs/embxp-wholesale |
Disallow | *content-pool |
Allow | *content-pool/*.jpg |
Allow | *content-pool/*.png |
Allow | *content-pool/*.svg |
Allow | *content-pool/*.jpeg |
Allow | /vans/*/content-pool/apps |
Other Records
Field | Value |
---|---|
sitemap | https://www.mbmelbourne.com.au/sitemaponeweb/sitemap.index.xml.gz |