allianz.com.au
robots.txt
Robots Exclusion Standard data for allianz.com.au
Resource Scan
Scan Details
Site Domain | allianz.com.au |
Base Domain | allianz.com.au |
Scan Status | Ok |
Last Scan | 2024-05-19T09:24:36+00:00 |
Next Scan | 2024-06-02T09:24:36+00:00 |
Last Scan
Scanned | 2024-05-19T09:24:36+00:00 |
URL | https://allianz.com.au/robots.txt |
Redirect | https://www.allianz.com.au:443/robots.txt |
Redirect Domain | www.allianz.com.au |
Redirect Base | allianz.com.au |
Domain IPs | 3.125.58.169, 35.158.70.45 |
Redirect IPs | 108.157.254.103, 108.157.254.52, 108.157.254.60, 108.157.254.91, 2600:9000:2753:2800:16:5779:1300:93a1, 2600:9000:2753:3800:16:5779:1300:93a1, 2600:9000:2753:3c00:16:5779:1300:93a1, 2600:9000:2753:a000:16:5779:1300:93a1, 2600:9000:2753:aa00:16:5779:1300:93a1, 2600:9000:2753:c800:16:5779:1300:93a1, 2600:9000:2753:d800:16:5779:1300:93a1, 2600:9000:2753:dc00:16:5779:1300:93a1 |
Response IP | 108.157.254.52 |
Found | Yes |
Hash | 3aac9a8d99ba261633e1303d266479789143f6a55f9e4ff956804b2852a233c4 |
SimHash | f8382042c5d7 |
Groups
*
Rule | Path |
---|---|
Disallow | /aalaus/aalaus.nsf/* |
Disallow | /preview/* |
Disallow | /s/AFG_Free_Offer |
Disallow | /s/allianz-nswctp-itc |
Disallow | /s/car-insurance-conditions |
Disallow | /s/life-insurance-conditions |
Disallow | /s/onlineclaims |
Disallow | /allianz-finance/* |
Disallow | /s/home-ab-test |
Disallow | /fuel/* |
Disallow | /s/terms-conditions-travel-* |
Disallow | /internet/clubmarine.nsf/* |
Disallow | /internet/clubnz.nsf/* |
Disallow | /internet/onlineclaims.nsf/* |
Disallow | /internet/onlineclaims.nsf/* |
Disallow | /wc/cn.nsf/* |
Disallow | /ctFrame.htm |
Disallow | /system/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.allianz.com.au/sitemap.xml |
sitemap | https://www.allianz.com.au/cdn/aalaus.nsf/sitemap.xml |
Comments