brodit.co.uk
robots.txt

Robots Exclusion Standard data for brodit.co.uk

Resource Scan

Scan Details

Site Domain brodit.co.uk
Base Domain brodit.co.uk
Scan Status Ok
Last Scan2026-01-26T15:04:56+00:00
Next Scan 2026-02-25T15:04:56+00:00

Last Scan

Scanned2026-01-26T15:04:56+00:00
URL https://brodit.co.uk/robots.txt
Redirect https://www.brodit.co.uk/robots.txt
Redirect Domain www.brodit.co.uk
Redirect Base brodit.co.uk
Domain IPs 104.21.39.210, 172.67.148.128, 2606:4700:3037::6815:27d2, 2606:4700:3037::ac43:9480
Redirect IPs 104.21.39.210, 172.67.148.128, 2606:4700:3037::6815:27d2, 2606:4700:3037::ac43:9480
Response IP 104.21.39.210
Found Yes
Hash 668a0a61b18757042e1a3c3116858595d37fa22c31fc6278a75c7803f1e3ebee
SimHash e019d44481d7

Groups

*

Rule Path
Disallow /admin/*

Other Records

Field Value
crawl-delay 15

bytespider

Rule Path
Disallow /

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.brodit.co.uk/googlesitemap.asp