findthisbest.co.uk
robots.txt

Robots Exclusion Standard data for findthisbest.co.uk

Resource Scan

Scan Details

Site Domain findthisbest.co.uk
Base Domain findthisbest.co.uk
Scan Status Ok
Last Scan2025-05-07T18:17:58+00:00
Next Scan 2025-05-14T18:17:58+00:00

Last Scan

Scanned2025-05-07T18:17:58+00:00
URL https://findthisbest.co.uk/robots.txt
Redirect https://www.findthisbest.co.uk/robots.txt
Redirect Domain www.findthisbest.co.uk
Redirect Base findthisbest.co.uk
Domain IPs 104.21.53.196, 172.67.217.249, 2606:4700:3031::ac43:d9f9, 2606:4700:3033::6815:35c4
Redirect IPs 104.21.53.196, 172.67.217.249, 2606:4700:3031::ac43:d9f9, 2606:4700:3033::6815:35c4
Response IP 104.21.53.196
Found Yes
Hash 3da01c5c27d29f271766c5f5b15fd21413fe36911d576b4881b48349cf2ee3a2
SimHash 0b1d85407e99

Groups

*

Rule Path
Disallow /ajax/
Disallow /redirect
Disallow /outlink/
Disallow /search
Disallow /cdn-cgi/

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.findthisbest.co.uk/sitemap.xml