bpi.co.uk
robots.txt

Robots Exclusion Standard data for bpi.co.uk

Resource Scan

Scan Details

Site Domain bpi.co.uk
Base Domain bpi.co.uk
Scan Status Ok
Last Scan2026-02-17T09:51:34+00:00
Next Scan 2026-03-03T09:51:34+00:00

Last Scan

Scanned2026-02-17T09:51:34+00:00
URL https://bpi.co.uk/robots.txt
Redirect https://www.bpi.co.uk/robots.txt
Redirect Domain www.bpi.co.uk
Redirect Base bpi.co.uk
Domain IPs 104.26.12.58, 104.26.13.58, 172.67.72.202, 2606:4700:20::681a:c3a, 2606:4700:20::681a:d3a, 2606:4700:20::ac43:48ca
Redirect IPs 104.26.12.58, 104.26.13.58, 172.67.72.202, 2606:4700:20::681a:c3a, 2606:4700:20::681a:d3a, 2606:4700:20::ac43:48ca
Response IP 172.67.72.202
Found Yes
Hash 3d36afa0984faa289915e2c587cbd43eafb59e234d69a99b65fcdf5d3814338a
SimHash 2954d801e8fb

Groups

*

Rule Path
Disallow /pick-institution
Disallow /terms
Disallow /privacy-policy
Disallow /legal
Disallow /backoffice
Disallow /networks/*/recruiter/jobs

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ut-dorkbot

Rule Path
Disallow /

ut-dorkbot/1.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bpi.co.uk/sitemap.xml