bupa.co.uk
robots.txt

Robots Exclusion Standard data for bupa.co.uk

Resource Scan

Scan Details

Site Domain bupa.co.uk
Base Domain bupa.co.uk
Scan Status Ok
Last Scan2024-06-26T22:01:26+00:00
Next Scan 2024-07-10T22:01:26+00:00

Last Scan

Scanned2024-06-26T22:01:26+00:00
URL https://bupa.co.uk/robots.txt
Redirect https://www.bupa.co.uk/robots.txt
Redirect Domain www.bupa.co.uk
Redirect Base bupa.co.uk
Domain IPs 213.121.86.72
Redirect IPs 104.18.43.239, 172.64.144.17, 2606:4700:4400::6812:2bef, 2606:4700:4400::ac40:9011
Response IP 104.18.43.239
Found Yes
Hash 84cff3c43d3c01111b68899d8474222349bd9d1c4d45946a54ac36a881c12bd1
SimHash 1c099e45ef02

Groups

*

Rule Path
Disallow /search
Disallow *cssId*
Disallow /vivisimo/
Disallow /jahia/
Disallow /bupaukcmshome/
Disallow /wellnessprogramme/jsp/healthcheck/index.jsp
Disallow /cdn-cgi/l/email-protection
Disallow /resource/maint/
Disallow /care-services/care-journey-guide-ppc
Disallow /accessonline/
Disallow /*?lname
Disallow /~/media/files/mms/bins-09855.pdf
Disallow /~/media/Files/MMS/MMS-hosting/bins-10942.pdf
Disallow /test-pages*
Disallow /sitecore/content*
Disallow *data-items*
Disallow *?tab=*
Disallow /~/media/files/mms/bins-02686.pdf
Disallow /~/media/files/mms/bins-02528.pdf
Disallow /~/media/files/mms/bins-00044.pdf
Disallow /~/media/files/mms/bhf-10145.pdf
Disallow /~/media/files/mms/bins-07259.pdf
Disallow /~/media/files/mms/bins-07776.pdf
Disallow /~/media/files/mms/bins-07347.pdf
Disallow /~/media/files/mms/bins-07345.pdf
Disallow /~/media/files/mms/bins-06755.pdf
Disallow /~/media/files/mms/bins-10597.pdf
Disallow /~/media/files/mms/bins-10676.pdf
Disallow /~/media/files/mms/bins-10596.pdf
Disallow /~/media/files/mms/bhf-00722*
Disallow /~/media/files/mms/bhf-12257.pdf

uptimerobot/2.0

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

ezooms.bot@gmail.com

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-ba

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-si

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-swa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-ct

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

splitsignalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-coub

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.bupa.co.uk/sitemap.xml

Warnings

  • 2 invalid lines.