au.com
robots.txt
Robots Exclusion Standard data for au.com
Resource Scan
Scan Details
| Site Domain | au.com |
| Base Domain | au.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T21:12:45+00:00 |
| Next Scan | 2024-11-25T21:12:45+00:00 |
Last Scan
| Scanned | 2024-10-26T21:12:45+00:00 |
| URL | https://au.com/robots.txt |
| Redirect | https://www.au.com/robots.txt |
| Redirect Domain | www.au.com |
| Redirect Base | au.com |
| Domain IPs | 175.129.0.108, 2001:268:fa03:500:175:129:0:108 |
| Redirect IPs | 18.155.68.38, 18.155.68.46, 18.155.68.71, 18.155.68.87, 2600:9000:23d2:1600:d:354b:4180:93a1, 2600:9000:23d2:200:d:354b:4180:93a1, 2600:9000:23d2:2600:d:354b:4180:93a1, 2600:9000:23d2:4000:d:354b:4180:93a1, 2600:9000:23d2:b600:d:354b:4180:93a1, 2600:9000:23d2:cc00:d:354b:4180:93a1, 2600:9000:23d2:da00:d:354b:4180:93a1, 2600:9000:23d2:f800:d:354b:4180:93a1 |
| Response IP | 18.155.68.46 |
| Found | Yes |
| Hash | c5b0f5ec682d964bb325d999611c6b24269ff52c7fc15b553a0d5ce20b4a2a8f |
| SimHash | f90cba248c93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cs/pay342/ |
| Disallow | /cs/pay447/ |
| Disallow | /cs/pay457/ |
| Disallow | /support/faq/included/ |
| Disallow | /*jcr%3Acontent* |
| Disallow | /*_jcr_content* |
| Disallow | /content/dam/au-com/mobile/gimon/disallow/pdf/*.pdf$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.au.com/sitemap.xml |
| sitemap | https://www.au.com/ipad/ipad_sitemap.xml |
| sitemap | https://www.au.com/iphone/iphone_sitemap.xml |
| sitemap | https://www.au.com/apple-watch/apple_watch_sitemap.xml |