lseg.com
robots.txt

Robots Exclusion Standard data for lseg.com

Resource Scan

Scan Details

Site Domain lseg.com
Base Domain lseg.com
Scan Status Ok
Last Scan2024-06-20T06:56:24+00:00
Next Scan 2024-07-20T06:56:24+00:00

Last Scan

Scanned2024-06-20T06:56:24+00:00
URL https://lseg.com/robots.txt
Redirect https://www.lseg.com/robots.txt
Redirect Domain www.lseg.com
Redirect Base lseg.com
Domain IPs 104.18.40.188, 172.64.147.68
Redirect IPs 108.156.133.123, 108.156.133.21, 108.156.133.49, 108.156.133.86, 2600:9000:2755:1000:2:2fdd:fc0:93a1, 2600:9000:2755:3800:2:2fdd:fc0:93a1, 2600:9000:2755:5a00:2:2fdd:fc0:93a1, 2600:9000:2755:6200:2:2fdd:fc0:93a1, 2600:9000:2755:7200:2:2fdd:fc0:93a1, 2600:9000:2755:8400:2:2fdd:fc0:93a1, 2600:9000:2755:9800:2:2fdd:fc0:93a1, 2600:9000:2755:ba00:2:2fdd:fc0:93a1
Response IP 108.156.133.86
Found Yes
Hash 1dd6698bbd1dca3b54c5edc9caddc251b1169d4be810a4564fd543234496beb8
SimHash 0a35217c8f95

Groups

*

Rule Path
Disallow /en/12435435*
Disallow /en/forms*
Disallow /en/modal*
Disallow /en/fx/forms*
Disallow /page-layouts*
Disallow /en/reference-components*
Disallow /en/site-navigation.html
Disallow /en/media-centre/press-releases/test*
Disallow /ja/12435435*
Disallow /ja/forms*
Disallow /ja/reference-components*
Disallow /ja/site-navigation.html
Disallow /ja/fx/forms*
Disallow /en/insights/forms
Disallow /en/insights/reference-components
Disallow /en/insights/page-layouts
Disallow /en/ftse-russell/forms
Disallow /en/ftse-russell/sustainable-investment-metrics/si-metrics-config-pages
Disallow /en/ftse-russell/site-navigation
Disallow /en/ftse-russell/errors
Disallow /en/ftse-russell/12435435
Disallow /en/ftse-russell/page-layouts
Disallow /en/ftse-russell/reference-components
Disallow /en/ftse-russell/thank-you
Disallow /en/ftse-russell/market-insights/thank-you
Disallow /en/ftse-russell/client-service-portal/thank-you
Disallow /en/data-analytics/12435435
Disallow /en/data-analytics/reference-components
Disallow /en/data-analytics/forms
Disallow /en/data-analytics/modal
Disallow /zh/ftse-russell/forms
Disallow /zh/ftse-russell/reference-components
Disallow /zh/ftse-russell/12435435
Disallow /zh/ftse-russell/errors
Disallow /en/risk-intelligence/forms
Disallow /en/risk-intelligence/reference-components
Disallow /en/risk-intelligence/page-layouts
Disallow /en/training/learning-centre/learning-paths/customer-solutions

Other Records

Field Value
sitemap https://www.lseg.com/en/sitemap-index.xml
sitemap https://www.lseg.com/ja/sitemap-index.xml

Comments

  • Data is just the beginning