h-l.co.uk
robots.txt
Robots Exclusion Standard data for h-l.co.uk
Resource Scan
Scan Details
Site Domain | h-l.co.uk |
Base Domain | h-l.co.uk |
Scan Status | Ok |
Last Scan | 2024-05-18T13:49:43+00:00 |
Next Scan | 2024-06-17T13:49:43+00:00 |
Last Scan
Scanned | 2024-05-18T13:49:43+00:00 |
URL | http://h-l.co.uk/robots.txt |
Redirect | https://www.hl.co.uk/robots.txt |
Redirect Domain | www.hl.co.uk |
Redirect Base | hl.co.uk |
Domain IPs | 178.78.121.137 |
Redirect IPs | 52.84.229.20, 52.84.229.54, 52.84.229.78, 52.84.229.91 |
Response IP | 52.84.229.91 |
Found | Yes |
Hash | 04a14460f4a2a4b18fbdeeb54cf944e2667432fa9fde5007f6911a11aad62864 |
SimHash | 3c020c62ec97 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /app/ |
Disallow | /.well-known/ |
Disallow | /font-variant-test/ |
Disallow | /form-files/ |
Disallow | /new-pages/ |
Disallow | /amp/ |
Disallow | /errors/ |
Disallow | /?p=12473 |
Disallow | /research/ |
Disallow | /free-guides/unsubscribe-from-emails |
Disallow | /pensions/retirement-videos |
Disallow | /pensions/retirement-videos/ |
Disallow | /shares/news-article |
Disallow | /authoring |
Disallow | /partners |
Disallow | /partners/ |
Disallow | /_media |
Disallow | /_media/ |
Disallow | /funds/master-portfolios/ajax |
Disallow | /pensions/sipp/investment-ideas-for-your-sipp/ajax |
Disallow | /website-unavailable |
Disallow | /matrix-down-maad-up |
Disallow | /matrix-down-maad-down |
Disallow | /functions |
Disallow | /functions/ |
Disallow | /global-content |
Disallow | /global-content/ |
Disallow | /shares/chart-epic-search/search |
Disallow | /forms |
Disallow | /forms/ |
Disallow | /investment-services/isa/thank-you-isa |
Disallow | /investment-services/isa/thank-you-isa/ |
Disallow | /investment-services/isa/isa-survey |
Disallow | /investment-services/isa/isa-survey/ |
Disallow | /mobile-app |
Disallow | /mobile-app/ |
Disallow | /feeds |
Disallow | /feeds/ |
Disallow | /news/tv/transfer-now |
Disallow | /news/tv/transfer-later |
Disallow | /news/tv/transfer-now-email |
Disallow | /news/tv/transfer-later-email |
Disallow | /news/tv/pensions |
Disallow | /my-accounts/logout |
Disallow | /my-accounts/maad-unavailable |
Disallow | /my-accounts/maad-unavailable/ |
Disallow | /my-accounts/fund-watch-list |
Disallow | /my-accounts/you-may-be-interested-in |
Disallow | /my-accounts/how-do-i-guides/see-how-many-deals-i-have-placed-this-month |
Disallow | /my-accounts/chart-guide |
Disallow | /my-accounts/header-full |
Disallow | /my-accounts/header-left-nav |
Disallow | /my-accounts/recommended-friend |
Disallow | /free-guides/dianomi/ |
Disallow | /investment-services/isa/isa-follow-up/form-thank-you-customisation |
Disallow | /funds/search-sedol/redirect |
Disallow | /pensions/sipp/sipp-tax-year-email-unsubscribe |
Disallow | /pensions/sipp/sipp-tax-year-email-unsubscribe2 |
Disallow | /pensions/sipp/sipp-tax-year-email-unsubscribe3 |
Disallow | /pensions/sipp/sipp-tax-year-email-unsubscribe4 |
Disallow | /pensions/sipp/sipp-tax-year-email-unsubscribe5 |
Disallow | /company-pensions/thank-you |
Disallow | /help-pages |
Disallow | /help-pages/ |
Disallow | /summer/live-comments |
Disallow | /summer/live-comments/ |
Disallow | /about-us/social-media/share-this-page |
Disallow | /transferring* |
Disallow | /transfer |
Disallow | /news/webview/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.hl.co.uk/sitemap.xml |
sitemap | https://www.hl.co.uk/shares/sitemap.xml |
sitemap | https://www.hl.co.uk/funds/sitemap.xml |
sitemap | https://www.hl.co.uk/investment-services/sitemap.xml |
sitemap | https://www.hl.co.uk/pensions/sitemap.xml |
sitemap | https://www.hl.co.uk/financial-advice/sitemap.xml |
sitemap | https://www.hl.co.uk/misc-sitemap.xml |
sitemap | https://www.hl.co.uk/news-sitemap.xml |
sitemap | https://www.hl.co.uk/free-guides/sitemap.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/a.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/b.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/c.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/d.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/e.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/f.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/g.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/h.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/i.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/j.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/k.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/l.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/m.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/n.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/o.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/p.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/q.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/r.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/s.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/t.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/u.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/v.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/w.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/x.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/y.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/z.xml |
sitemap | https://www.hl.co.uk/shares/sitemaps/0-9.xml |
sitemap | https://www.hl.co.uk/funds/sitemaps/ae.xml |
sitemap | https://www.hl.co.uk/funds/sitemaps/fj.xml |
sitemap | https://www.hl.co.uk/funds/sitemaps/ko.xml |
sitemap | https://www.hl.co.uk/funds/sitemaps/pt.xml |
sitemap | https://www.hl.co.uk/funds/sitemaps/u9.xml |
sitemap | https://www.hl.co.uk/retirement/sitemap.xml |
sitemap | https://www.hl.co.uk/workplace/sitemap.xml |
sitemap | https://www.hl.co.uk/help/help-sitemap.xml |
sitemap | https://www.hl.co.uk/learn/learn-sitemap.xml |
sitemap | https://www.hl.co.uk/article-sitemap.xml |
sitemap | https://www.hl.co.uk/shares/stock-market-summary/sitemap.xml |
sitemap | https://www.hl.co.uk/shares/share-research/sitemap.xml |
sitemap | https://www.hl.co.uk/shares/stock-market-news/sitemap.xml |
sitemap | https://www.hl.co.uk/features/sitemap.xml |
sitemap | https://www.hl.co.uk/beginners-guides/sitemap.xml |
sitemap | https://www.hl.co.uk/article-sitemaps/2019.xml |
sitemap | https://www.hl.co.uk/article-sitemaps/2020.xml |
sitemap | https://www.hl.co.uk/article-sitemaps/2021.xml |
sitemap | https://www.hl.co.uk/article-sitemaps/2022.xml |
sitemap | https://www.hl.co.uk/article-sitemaps/2023.xml |
sitemap | https://www.hl.co.uk/article-sitemaps/2024.xml |