sunlife.com.hk
robots.txt

Robots Exclusion Standard data for sunlife.com.hk

Resource Scan

Scan Details

Site Domain sunlife.com.hk
Base Domain sunlife.com.hk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-21T19:27:53+00:00
Next Scan 2026-03-21T19:27:53+00:00

Last Successful Scan

Scanned2024-11-19T08:29:47+00:00
URL https://sunlife.com.hk/robots.txt
Redirect https://www.sunlife.com.hk/robots.txt
Redirect Domain www.sunlife.com.hk
Redirect Base sunlife.com.hk
Domain IPs 23.203.72.93
Redirect IPs 23.203.72.93
Response IP 23.203.72.93
Found Yes
Hash ea2092c49d4f5e63760c835d04f5b347c1ca1ae94dbc13c12d2b0dbd3771957b
SimHash 680fdf95a693

Groups

*

Rule Path
Disallow /*?*vgnLocale=zh_TW
Disallow /*?*vgnLocale=en_CA
Disallow /*?*vgnLocale=zh_SG
Disallow /*?*target=1
Disallow /*?*&amp%3B
Disallow /*?*amp%3B
Disallow /*?*amp%3Bamp%3Bvgnextrefresh=1
Disallow /*?*vgnextrefresh=1
Disallow /*?*ecname=undefined&amp%3B&amp%3B

linkedinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.sunlife.com.hk/en/sitemap.xml
sitemap https://www.sunlife.com.hk/zh-hant/sitemap.xml
sitemap https://www.sunlife.com.hk/zh-hans/sitemap.xml

Comments

  • Delay LinkedInBot