aig.com.au
robots.txt
Robots Exclusion Standard data for aig.com.au
Resource Scan
Scan Details
| Site Domain | aig.com.au |
| Base Domain | aig.com.au |
| Scan Status | Ok |
| Last Scan | 2024-05-20T03:53:51+00:00 |
| Next Scan | 2024-06-19T03:53:51+00:00 |
Last Scan
| Scanned | 2024-05-20T03:53:51+00:00 |
| URL | https://aig.com.au/robots.txt |
| Redirect | https://www.aig.com.au:443/robots.txt |
| Redirect Domain | www.aig.com.au |
| Redirect Base | aig.com.au |
| Domain IPs | 23.20.163.89, 34.197.62.200 |
| Redirect IPs | 2600:9000:2003:3e00:10:c4dd:aac0:93a1, 2600:9000:2003:4000:10:c4dd:aac0:93a1, 2600:9000:2003:5400:10:c4dd:aac0:93a1, 2600:9000:2003:6600:10:c4dd:aac0:93a1, 2600:9000:2003:7800:10:c4dd:aac0:93a1, 2600:9000:2003:ac00:10:c4dd:aac0:93a1, 2600:9000:2003:e800:10:c4dd:aac0:93a1, 2600:9000:2003:f200:10:c4dd:aac0:93a1, 52.84.229.33, 52.84.229.60, 52.84.229.76, 52.84.229.89 |
| Response IP | 52.84.229.89 |
| Found | Yes |
| Hash | 86b4625b48652d3a590c7aa0025e46bd7956a939c03346d62fba752a4910e91a |
| SimHash | 879990147d36 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /etc/tags/ |
| Disallow | /apps/ |
| Disallow | /crx/ |
| Disallow | /libs/ |
| Disallow | /*_1472_300041 |
| Disallow | /*_1472_300043 |
| Disallow | /*_1472_300024 |
| Disallow | /*_1472_300022 |
| Disallow | /*_1472_300027 |
| Disallow | /*_1472_300025 |
| Disallow | /*_1472_300025 |
| Disallow | /*_1472_300028 |
| Disallow | /*_1472_460177 |
| Disallow | /*_1472_460173 |
| Disallow | /*_1472_460176 |
| Disallow | /*_1472_470158 |
| Disallow | /*_1472_481947 |
| Disallow | /*_1472_300054 |
| Disallow | /*_1472_300056 |
| Disallow | /*_1472_461479 |
| Disallow | /*_1472_461478 |
| Disallow | /*_1472_461480 |
| Disallow | /*_1472_470157 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.aig.com.au/sitemap.xml |
| sitemap | http://www.aig.com.au/news-sitemap.xml |