Log In Sign Up

landg.com
robots.txt

Robots Exclusion Standard data for landg.com

Resource Scan

Scan Details

Site Domain landg.com
Base Domain landg.com
Scan Status Ok
Last Scan2024-05-23T20:17:53+00:00
Next Scan 2024-06-22T20:17:53+00:00

Last Scan

Scanned2024-05-23T20:17:53+00:00
URL https://www.landg.com/robots.txt
Redirect https://www.legalandgeneral.com/robots.txt
Redirect Domain www.legalandgeneral.com
Redirect Base legalandgeneral.com
Domain IPs 13.226.2.120, 13.226.2.121, 13.226.2.122, 13.226.2.47, 2600:9000:21f8:1600:8:e8ad:2380:93a1, 2600:9000:21f8:3400:8:e8ad:2380:93a1, 2600:9000:21f8:3e00:8:e8ad:2380:93a1, 2600:9000:21f8:6800:8:e8ad:2380:93a1, 2600:9000:21f8:800:8:e8ad:2380:93a1, 2600:9000:21f8:9600:8:e8ad:2380:93a1, 2600:9000:21f8:e000:8:e8ad:2380:93a1, 2600:9000:21f8:fa00:8:e8ad:2380:93a1
Redirect IPs 18.164.174.22, 18.164.174.26, 18.164.174.37, 18.164.174.73, 2600:9000:2778:5000:11:be78:8e80:93a1, 2600:9000:2778:5c00:11:be78:8e80:93a1, 2600:9000:2778:9400:11:be78:8e80:93a1, 2600:9000:2778:a000:11:be78:8e80:93a1, 2600:9000:2778:b200:11:be78:8e80:93a1, 2600:9000:2778:b600:11:be78:8e80:93a1, 2600:9000:2778:c00:11:be78:8e80:93a1, 2600:9000:2778:fe00:11:be78:8e80:93a1
Response IP 18.165.171.52
Found Yes
Hash b8855a308ff0caf3f31352d9a94a15c8865d7c43fd4498c1058d84577c303a03
SimHash 1a361cb4c348

Groups

*

Rule Path
Disallow /test_only/
Disallow /mortgageclub/ar/*
Disallow /*TeamInfo.xml$
Disallow /retirement/retirement-options/case-studies/segmenta/*
Disallow /retirement/retirement-options/case-studies/segmentb/*
Disallow /retirement/retirement-options/case-studies/segmentc/*
Disallow /retirement/retirement-options/case-studies/segmentd/*
Disallow /retirement/retirement-options/case-studies/segmente/*
Disallow /retirement/retirement-options/case-studies/segmentf/*
Disallow /retirement/retirement-options/case-studies/segmentg/*
Disallow /retirement/retirement-options/case-studies/segmenth/*
Disallow /retirement/retirement-options/case-studies/segmenti/*
Disallow /retirement/retirement-options/case-studies/segmentj/*
Disallow /retirement/retirement-options/case-studies/segmentk/*
Disallow /retirement/retirement-options/case-studies/segmentl/*
Disallow /retirement/retirement-options/case-studies/segmentm/*
Disallow /retirement/retirement-options/case-studies/segmentn/*
Disallow /retirement/retirement-options/case-studies/segmento/*
Disallow /adviser/mortgage-club/news-and-insight/digest/articles/*
Disallow /adviser/mortgage-club/sjp/*
Disallow /co-operative-bank/*
Disallow /files/library/protection/miscellaneous/q47218lloyds.pdf
Disallow /leeds/*
Disallow /landg-assets/adviser/retirement/literature-and-forms/customer-guide/DA400.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/customer-guide/DA401.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/customer-guide/DA403.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/customer-guide/DA404.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/product-summary/DA631.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/product-summary/DA632.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/product-summary/DA633.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/product-summary/DA634.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/terms-and-conditions/DA438.pdf
Disallow /landg-assets/adviser/retirement/literature-and-forms/application-form/DA702.pdf
Disallow /web_resources/digital-estate-v3/estate/resources-list.txt
Disallow /web_resources/digital-estate-v3/estate/css-and-js-list.txt
Disallow /web_resources/digital-estate-v3/estate/assets/cms-assets/ingestion/HANDLEBAR_REGEX_DE.txt
Disallow /web_resources/digital-estate-v3/estate/assets/iframe-tools/README.txt
Disallow /web_resources/digital-estate-v3/estate/version.txt
Disallow /web_resources/dotcom-elements/prod/resources-list.txt
Disallow /tools/*
Back to top

Other Records

Field Value
sitemap https://www.legalandgeneral.com/sitemap.xml
Back to top