myer.com.au
robots.txt
Robots Exclusion Standard data for myer.com.au
Resource Scan
Scan Details
| Site Domain | myer.com.au |
| Base Domain | myer.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-04T06:39:39+00:00 |
| Next Scan | 2024-12-04T06:39:39+00:00 |
Last Scan
| Scanned | 2024-11-04T06:39:39+00:00 |
| URL | https://myer.com.au/robots.txt |
| Redirect | https://www.myer.com.au/robots.txt |
| Redirect Domain | www.myer.com.au |
| Redirect Base | myer.com.au |
| Domain IPs | 108.156.133.13, 108.156.133.22, 108.156.133.7, 108.156.133.84 |
| Redirect IPs | 108.157.254.100, 108.157.254.12, 108.157.254.127, 108.157.254.34 |
| Response IP | 108.157.254.12 |
| Found | Yes |
| Hash | eb9aa549da69653aec05427d184ea1a5d97f91d5465b60bb396a79375ac5999f |
| SimHash | f559564491d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*facets%3D |
| Disallow | /*sort%3D |
| Disallow | /*colour%3D |
| Disallow | /*size%3D |
| Disallow | */search* |
| Disallow | /*login |
| Disallow | /webapp/wcs/stores/servlet/ShoppingBag?catalogId= |
| Disallow | /webapp/wcs/stores/servlet/Checkout?catalogId= |
| Disallow | /*account |
| Disallow | /offers/ |
| Disallow | /just-landed-709561--1/ |
| Disallow | /women/ |
| Disallow | /men/ |
| Disallow | /beauty/ |
| Disallow | /kidsbaby/ |
| Disallow | /all-toys/ |
| Disallow | /home/ |
| Disallow | /electrical/ |
| Disallow | /gifts/ |
| Disallow | /*/all$ |
| Disallow | /webapp/* |
| Disallow | /shop/mystore/ |
| Disallow | /*pageNumber*pageNumber* |
| Disallow | /promo/ |
| Disallow | *women-multi-buys* |
| Disallow | *multi-buy-offers* |
| Disallow | *multi-buy-kids* |
| Disallow | *?promo_position=* |
| Disallow | *?promo_creative=* |
| Disallow | *delivery/v1/resources/* |
| Disallow | */authoring/v1/changes/* |
| Disallow | */ProductDisplay?* |
| Allow | /*CompanyId*size* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.myer.com.au/sitemap/sitemap_20251.xml.gz |
| sitemap | https://www.myer.com.au/sitemap/buy-sitemap.xml |