metlife.co.uk
robots.txt

Robots Exclusion Standard data for metlife.co.uk

Resource Scan

Scan Details

Site Domain metlife.co.uk
Base Domain metlife.co.uk
Scan Status Ok
Last Scan2024-09-23T04:02:58+00:00
Next Scan 2024-10-23T04:02:58+00:00

Last Scan

Scanned2024-09-23T04:02:58+00:00
URL https://metlife.co.uk/robots.txt
Redirect https://www.metlife.co.uk/robots.txt
Redirect Domain www.metlife.co.uk
Redirect Base metlife.co.uk
Domain IPs 216.163.251.45
Redirect IPs 108.157.254.118, 108.157.254.25, 108.157.254.5, 108.157.254.57, 2600:9000:2753:600:12:f7ca:ea00:93a1, 2600:9000:2753:8c00:12:f7ca:ea00:93a1, 2600:9000:2753:a400:12:f7ca:ea00:93a1, 2600:9000:2753:bc00:12:f7ca:ea00:93a1, 2600:9000:2753:d200:12:f7ca:ea00:93a1, 2600:9000:2753:e00:12:f7ca:ea00:93a1, 2600:9000:2753:e800:12:f7ca:ea00:93a1, 2600:9000:2753:f400:12:f7ca:ea00:93a1
Response IP 108.157.254.118
Found Yes
Hash 443e7bfd28bd2f49f86047ea885891b4c7b58fbcde22e648fa5832f1c5e80c98
SimHash db158c05d517

Groups

*

Rule Path
Disallow /*aemform.iframe.html*

Other Records

Field Value
sitemap https://www.metlife.co.uk/sitemap/_jcr_content/content/sitemap.xml

Warnings

  • 6 invalid lines.