Log In Sign Up

lexisnexis.co.uk
robots.txt

Robots Exclusion Standard data for lexisnexis.co.uk

Resource Scan

Scan Details

Site Domain lexisnexis.co.uk
Base Domain lexisnexis.co.uk
Scan Status Ok
Last Scan2024-09-26T19:00:27+00:00
Next Scan 2024-10-10T19:00:27+00:00

Last Scan

Scanned2024-09-26T19:00:27+00:00
URL https://lexisnexis.co.uk/robots.txt
Redirect https://www.lexisnexis.co.uk/robots.txt
Redirect Domain www.lexisnexis.co.uk
Redirect Base lexisnexis.co.uk
Domain IPs 207.24.42.3
Redirect IPs 125.252.229.179
Response IP 23.77.2.122
Found Yes
Hash 6b5190e39dce3e74e4f2fff79e8bb59915490295ddbaf0fe967eae5dcb58427e
SimHash 740dc86ceec8

Groups

*

Rule Path
Disallow /LexisCalculators/
Disallow /profile/
Disallow /en-uk/products/campaign/
Disallow /en-uk/customer-experience/
Disallow /blog?page=*
Disallow /blog/registration
Disallow /legal/pagenotfound?
Disallow /legal/search?
Disallow /tolley/tax?p=*
Disallow /tolley/tax/?p=*
Disallow *?practicearea=*
Disallow *?board=*
Disallow /pdf/
Disallow /search?query=*
Disallow */en-uk/legal/*
Disallow */en-uk/blog/*
Disallow */en-uk/tolley/*
Disallow *?pa=*
Disallow */ciot-att-newsletter*
Disallow */legal/news?page=*
Disallow */legal/practice-notes?page=*
Disallow */legal/q-a?page=*
Disallow */legal/precedents?page=*
Disallow /test/*
Disallow /en-uk/test/*
Disallow /store/maintenance
Disallow /store/set-promotion
Disallow /store/_/
Disallow /store/*?sq_content_src=
Disallow /store/__lib
Disallow /store/__fudge
Disallow /store/__admin
Disallow /store/*/_admin
Disallow /store/*/_edit
Disallow /store/*/_performance
Disallow /store/_admin
Disallow /store/_edit
Disallow /store/_performance
Disallow /store/login
Disallow /store/my-profile
Disallow /store/order-details
Disallow /store/search?query=*
Disallow /*?SQ_DESIGN_NAME=
Disallow /*?SQ_PAINT_LAYOUT_NAME=

trendiction

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot
ahrefsbot
siteauditbot
semrushbot
dotbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot
screaming frog seo spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bitlybot
barkrowler
seznambot
blexbot
aihitbot
bdcbot
ccbot
heritrix
anthropic-ai
cohere-ai
ia_archiver
omgili
omgilibot
piplbot
bytespider
claudebot
claude-web
facebookbot
magpie-crawler
newsnow
news-please
perplexitybot
perplexity-ai
baiduspider
baiduspider-video
baiduspider-image
bytedance
bytespider
gptbot
google-extended
amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.lexisnexis.co.uk/sitemap.xml
sitemap https://www.lexisnexis.co.uk/blog/sitemap/sitemap-index.xml
sitemap https://www.lexisnexis.co.uk/blog/sitemap/sitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/8d7e39af-397e-4b2f-8350-2c712cf587ba/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/8d7e39af-397e-4b2f-8350-2c712cf587ba/sitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/aa8d732c-5244-48c4-b174-9d11995f52f8/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/aa8d732c-5244-48c4-b174-9d11995f52f8/sitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/b3235cbd-7b58-4537-b0d5-f6fdd822b0f6/sitemap-2.gz
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/b3235cbd-7b58-4537-b0d5-f6fdd822b0f6/sitemap-2.xml
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/b3235cbd-7b58-4537-b0d5-f6fdd822b0f6/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/b3235cbd-7b58-4537-b0d5-f6fdd822b0f6/sitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/e126cd5e-7fc2-4dbc-b31a-a1fa2c4ed57e/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/commentary/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/e126cd5e-7fc2-4dbc-b31a-a1fa2c4ed57e/sitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/glossarysitemaplibrary/glossarysitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/glossarysitemaplibrary/glossarysitemapupdated.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/newssitemaplibrary/fullnewssitemap-2.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/newssitemaplibrary/fullnewssitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/newssitemaplibrary/fullnewssitemapupdated-3.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/newssitemaplibrary/fullnewssitemapupdated-2.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/newssitemaplibrary/fullnewssitemapupdated.xml
sitemap https://www.lexisnexis.co.uk/legal/docs/default-source/newssitemaplibrary/newssitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap-index.xml
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap.xml
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap-2.gz
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap-2.xml
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap-3.gz
sitemap https://www.lexisnexis.co.uk/legal/legislation/uk-parliament-acts/sitemap/sitemap-3.xml
sitemap https://www.lexisnexis.co.uk/legal/legislation/scottish-parliament-acts/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/30e00852-217e-4708-a4e3-141bfcf8fe06/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/legislation/scottish-parliament-acts/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/4cd14103-5384-4bed-bacf-99dbb2dc0182/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/legislation/scottish-parliament-acts/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/1d7e0552-e8f1-4e94-b01b-c6fa327f8a5b/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/sitemap/sitemap-index.xml
sitemap https://www.lexisnexis.co.uk/legal/sitemap/sitemap.gz
sitemap https://www.lexisnexis.co.uk/legal/sitemap/sitemap.xml
sitemap https://www.lexisnexis.co.uk/store/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/1212b1e2-316e-4821-b0f5-1b70a6c8b5b0/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/1212b1e2-316e-4821-b0f5-1b70a6c8b5b0/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/18c1743e-1123-402e-821b-5d5e8f97066f/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/18c1743e-1123-402e-821b-5d5e8f97066f/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/598d3370-8b71-4e85-ab06-e6e0a4c62fe3/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/598d3370-8b71-4e85-ab06-e6e0a4c62fe3/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/5e5b1f84-336b-4390-aa5c-05ded78ff4dc/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/5e5b1f84-336b-4390-aa5c-05ded78ff4dc/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/b971a530-de4b-4c50-84ea-3f35a8e8390f/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/b971a530-de4b-4c50-84ea-3f35a8e8390f/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/d6c851d5-1b0b-4695-8100-2a218e185338/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/systemlibrariesprovider/xmlsitemapgeneratorlibrary/d6c851d5-1b0b-4695-8100-2a218e185338/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/sitemap/sitemap-index.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/sitemap/sitemap.gz
sitemap https://www.lexisnexis.co.uk/tolley/tax/sitemap/sitemap.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/default-source/newssitemaplibrary/fullnewssitemapupdated.xml
sitemap https://www.lexisnexis.co.uk/tolley/tax/docs/default-source/newssitemaplibrary/newssitemap.xml
Back to top