mediasuper.com.au
robots.txt
Robots Exclusion Standard data for mediasuper.com.au
Resource Scan
Scan Details
| Site Domain | mediasuper.com.au |
| Base Domain | mediasuper.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-23T12:35:51+00:00 |
| Next Scan | 2024-10-23T12:35:51+00:00 |
Last Scan
| Scanned | 2024-09-23T12:35:51+00:00 |
| URL | https://mediasuper.com.au/robots.txt |
| Redirect | https://www.mediasuper.com.au/robots.txt |
| Redirect Domain | www.mediasuper.com.au |
| Redirect Base | mediasuper.com.au |
| Domain IPs | 15.197.251.228, 3.33.209.153 |
| Redirect IPs | 18.155.68.31, 18.155.68.52, 18.155.68.81, 18.155.68.82, 2600:9000:23d2:5000:17:e813:f200:93a1, 2600:9000:23d2:5c00:17:e813:f200:93a1, 2600:9000:23d2:8e00:17:e813:f200:93a1, 2600:9000:23d2:9600:17:e813:f200:93a1, 2600:9000:23d2:9800:17:e813:f200:93a1, 2600:9000:23d2:a200:17:e813:f200:93a1, 2600:9000:23d2:d600:17:e813:f200:93a1, 2600:9000:23d2:e600:17:e813:f200:93a1 |
| Response IP | 18.155.68.52 |
| Found | Yes |
| Hash | 31db05d35895b34e00f411cfd0263a75b4ea151a09ffdfb04f97c4e9f9198ba9 |
| SimHash | 4914dc508483 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dist/ |
| Disallow | /search |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mediasuper.com.au/sitemap.xml |