aig.co.nz
robots.txt

Robots Exclusion Standard data for aig.co.nz

Resource Scan

Scan Details

Site Domain aig.co.nz
Base Domain aig.co.nz
Scan Status Ok
Last Scan2024-05-20T17:55:49+00:00
Next Scan 2024-06-19T17:55:49+00:00

Last Scan

Scanned2024-05-20T17:55:49+00:00
URL https://aig.co.nz/robots.txt
Redirect https://www.aig.co.nz:443/robots.txt
Redirect Domain www.aig.co.nz
Redirect Base aig.co.nz
Domain IPs 23.20.163.89, 34.197.62.200
Redirect IPs 2600:9000:2003:1000:10:c4dd:aac0:93a1, 2600:9000:2003:5000:10:c4dd:aac0:93a1, 2600:9000:2003:5200:10:c4dd:aac0:93a1, 2600:9000:2003:a00:10:c4dd:aac0:93a1, 2600:9000:2003:b200:10:c4dd:aac0:93a1, 2600:9000:2003:b400:10:c4dd:aac0:93a1, 2600:9000:2003:d600:10:c4dd:aac0:93a1, 2600:9000:2003:d800:10:c4dd:aac0:93a1, 52.84.229.33, 52.84.229.60, 52.84.229.76, 52.84.229.89
Response IP 52.84.229.60
Found Yes
Hash 3f374b81744185a22148a8479f516cd9567c95eb1c8587dd264f40ac9de7633f
SimHash e11458148f72

Groups

*

Rule Path
Disallow /etc/
Disallow /apps/
Disallow /crx/
Disallow /libs/

Other Records

Field Value
sitemap https://www.aig.co.nz/sitemap.xml
sitemap https://www.aig.co.nz/news-sitemap.xml