pnbmetlife.com
robots.txt

Robots Exclusion Standard data for pnbmetlife.com

Resource Scan

Scan Details

Site Domain pnbmetlife.com
Base Domain pnbmetlife.com
Scan Status Ok
Last Scan2024-05-10T13:46:26+00:00
Next Scan 2024-06-09T13:46:26+00:00

Last Scan

Scanned2024-05-10T13:46:26+00:00
URL https://www.pnbmetlife.com/robots.txt
Domain IPs 13.227.254.118, 13.227.254.48, 13.227.254.66, 13.227.254.98, 2600:9000:200a:1000:7:84cb:9440:93a1, 2600:9000:200a:1200:7:84cb:9440:93a1, 2600:9000:200a:1400:7:84cb:9440:93a1, 2600:9000:200a:4200:7:84cb:9440:93a1, 2600:9000:200a:7c00:7:84cb:9440:93a1, 2600:9000:200a:7e00:7:84cb:9440:93a1, 2600:9000:200a:8600:7:84cb:9440:93a1, 2600:9000:200a:da00:7:84cb:9440:93a1
Response IP 13.227.254.118
Found Yes
Hash 318508ff98c0a27c7605254c841cd210fb1754d4d3c4947c11725243ab726d61
SimHash a545d029ab84

Groups

*

Rule Path
Disallow /withdrawn-insurance-plans/
Disallow */junior-money-back.html
Disallow *Withdrawn-insurance-plan*.pdf
Disallow /wps/portal/dm/%21ut/p/z1/*
Disallow /wps/portal/%21ut/p/z1/*
Disallow /wps/portal/Home/Welcome/
Disallow /wps/portal/dm/Home/Welcome/
Disallow /wps/portal/Error/error404/
Disallow /wps/portal/Home/TestBlog/
Disallow /wps/myportal/Error/
Disallow /wps/portal/Home/Blog/
Disallow /wps/portal/Home/getCustomerList/
Disallow /wps/portal/Home/Getting-Started/
Disallow /wps/portal/%21ut/
Disallow /wps/portal/Home/CustomerFeedback/
Disallow /wps/um/secure/attributes/users/
Disallow /wps/portal/dm/Home/%21ut/
Disallow aem-uat.pnbmetlife.com/*
Disallow newsite.pnbmetlife.com/*

Other Records

Field Value
sitemap https://www.pnbmetlife.com/sitemap.xml