talbot.aig.com
robots.txt

Robots Exclusion Standard data for talbot.aig.com

Resource Scan

Scan Details

Site Domain talbot.aig.com
Base Domain aig.com
Scan Status Ok
Last Scan2024-05-18T00:52:57+00:00
Next Scan 2024-06-17T00:52:57+00:00

Last Scan

Scanned2024-05-18T00:52:57+00:00
URL https://talbot.aig.com/robots.txt
Domain IPs 2600:9000:2003:4e00:10:c4dd:aac0:93a1, 2600:9000:2003:6000:10:c4dd:aac0:93a1, 2600:9000:2003:a00:10:c4dd:aac0:93a1, 2600:9000:2003:a800:10:c4dd:aac0:93a1, 2600:9000:2003:b200:10:c4dd:aac0:93a1, 2600:9000:2003:c800:10:c4dd:aac0:93a1, 2600:9000:2003:d600:10:c4dd:aac0:93a1, 2600:9000:2003:fa00:10:c4dd:aac0:93a1, 52.84.229.33, 52.84.229.60, 52.84.229.76, 52.84.229.89
Response IP 52.84.229.60
Found Yes
Hash f6192e43c328dc7f91bcc266941a94e87db24c61b1956552133f318d91d11691
SimHash e31c380caff1

Groups

*

Rule Path
Disallow /etc/tags/
Disallow /apps/
Disallow /crx/
Disallow /libs/

Other Records

Field Value
sitemap https://talbot.aig.com/sitemap.xml