digital.nhs.uk
robots.txt

Robots Exclusion Standard data for digital.nhs.uk

Resource Scan

Scan Details

Site Domain digital.nhs.uk
Base Domain digital.nhs.uk
Scan Status Ok
Last Scan2024-06-22T01:02:15+00:00
Next Scan 2024-07-22T01:02:15+00:00

Last Scan

Scanned2024-06-22T01:02:15+00:00
URL https://digital.nhs.uk/robots.txt
Domain IPs 162.159.140.9, 172.66.0.9
Response IP 162.159.140.9
Found Yes
Hash 114a59ba2efe4976727ee96c7693cd5b66b3d3af01b8292503d287cc10af0a9f
SimHash 627ed850c2d2

Groups

googlebot

Rule Path
Disallow /search/
Disallow /about-nhs-digital/our-work/nhs-data-digital-and-technology-framework/
Disallow /services/nhs-app/pilot/
Disallow /about-nhs-digital/our-work/kwjhtu8zprny-standards-framework-draft/
Disallow /search
Disallow /services/path-to-live-hidden-folder/
Disallow /binaries/content/assets/
Disallow /binaries/content/documents/
Disallow /binaries/content/attic/
Disallow /binaries/content/taxonomies/
Disallow /binaries/content/urlrewriter/
Disallow /binaries/content/eforms/

*

Rule Path
Disallow /search/
Disallow /about-nhs-digital/our-work/nhs-data-digital-and-technology-framework/
Disallow /services/nhs-app/pilot/
Disallow /about-nhs-digital/our-work/kwjhtu8zprny-standards-framework-draft/
Disallow /search
Disallow /services/path-to-live-hidden-folder/
Disallow /binaries/

ahrefsbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

domainappender

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

domainsigmacrawler

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

openvas

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

crawl.sogou.com

Rule Path
Disallow /

dragonfly

Rule Path
Disallow /

wizenozebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://digital.nhs.uk/sitemap-combined.xml