aia.com
robots.txt

Robots Exclusion Standard data for aia.com

Resource Scan

Scan Details

Site Domain aia.com
Base Domain aia.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-13T10:11:44+00:00
Next Scan 2024-12-12T10:11:44+00:00

Last Successful Scan

Scanned2024-01-25T04:37:17+00:00
URL https://www.aia.com/robots.txt
Domain IPs 23.32.29.106, 23.32.29.88
Response IP 23.32.29.106
Found Yes
Hash 6f88b1b435fc85aa67bab7bdcf7f18840ff4e6601db2e72f8afbd0ad6e1f8657
SimHash 49004822c3b3

Groups

*

Rule Path
Allow /
Disallow /en/search
Disallow /zh-hk/search

Other Records

Field Value
sitemap https://www.aia.com/en/sitemap.xml
sitemap https://www.aia.com/zh-hk/sitemap.xml