bupa.co.uk
robots.txt

Robots Exclusion Standard data for bupa.co.uk

Resource Scan

Scan Details

Site Domain bupa.co.uk
Base Domain bupa.co.uk
Scan Status Ok
Last Scan2024-11-08T16:14:27+00:00
Next Scan 2024-11-22T16:14:27+00:00

Last Scan

Scanned2024-11-08T16:14:27+00:00
URL https://bupa.co.uk/robots.txt
Redirect https://www.bupa.co.uk/robots.txt
Redirect Domain www.bupa.co.uk
Redirect Base bupa.co.uk
Domain IPs 213.121.86.72
Redirect IPs 104.18.39.246, 172.64.148.10, 2606:4700:4400::6812:27f6, 2606:4700:4400::ac40:940a
Response IP 172.64.148.10
Found Yes
Hash 34743f2b7a54f98aab6695880c1db38e5b2e0a7b03af0b06eb068f46cbf0ec22
SimHash 1c099e05ee0a

Groups

*

Rule Path
Disallow /search
Disallow *cssId*
Disallow /vivisimo/
Disallow /jahia/
Disallow /bupaukcmshome/
Disallow /wellnessprogramme/jsp/healthcheck/index.jsp
Disallow /cdn-cgi/l/email-protection
Disallow /resource/maint/
Disallow /care-services/care-journey-guide-ppc
Disallow /accessonline/
Disallow /*?lname
Disallow /~/media/files/mms/bins-09855.pdf
Disallow /~/media/Files/MMS/MMS-hosting/bins-10942.pdf
Disallow /test-pages*
Disallow /sitecore/content*
Disallow *data-items*
Disallow *?tab=*
Disallow /~/media/files/mms/bins-02686.pdf
Disallow /~/media/files/mms/bins-02528.pdf
Disallow /~/media/files/mms/bins-00044.pdf
Disallow /~/media/files/mms/bhf-10145.pdf
Disallow /~/media/files/mms/bins-07259.pdf
Disallow /~/media/files/mms/bins-07776.pdf
Disallow /~/media/files/mms/bins-07347.pdf
Disallow /~/media/files/mms/bins-07345.pdf
Disallow /~/media/files/mms/bins-06755.pdf
Disallow /~/media/files/mms/bins-10597.pdf
Disallow /~/media/files/mms/bins-10676.pdf
Disallow /~/media/files/mms/bins-10596.pdf
Disallow /~/media/files/mms/bhf-00722*
Disallow /~/media/files/mms/bhf-12257.pdf
Disallow /~/media/Files/MMS/bins-16438*

uptimerobot/2.0

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

ezooms.bot@gmail.com

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-ba

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-si

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-swa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-ct

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

splitsignalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot-coub

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.bupa.co.uk/sitemap.xml

Warnings

  • 2 invalid lines.