stevefenton.co.uk
robots.txt

Robots Exclusion Standard data for stevefenton.co.uk

Resource Scan

Scan Details

Site Domain stevefenton.co.uk
Base Domain stevefenton.co.uk
Scan Status Ok
Last Scan6/10/2025, 11:17:42 PM
Next Scan 6/17/2025, 11:17:42 PM

Last Scan

Scanned6/10/2025, 11:17:42 PM
URL https://stevefenton.co.uk/robots.txt
Redirect https://www.stevefenton.co.uk/robots.txt
Redirect Domain www.stevefenton.co.uk
Redirect Base stevefenton.co.uk
Domain IPs 104.21.12.250, 172.67.196.210, 2606:4700:3030::ac43:c4d2, 2606:4700:3034::6815:cfa
Redirect IPs 104.21.12.250, 172.67.196.210, 2606:4700:3030::ac43:c4d2, 2606:4700:3034::6815:cfa
Response IP 104.21.12.250
Found Yes
Hash 9a7f8dcbfb9d8f90ac06bd0fcc79c270e0d37353596a1e3feb77f68ecae66c9f
SimHash e818dc1769c3

Groups

*

Rule Path
Disallow /

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

exabot

Rule Path
Disallow

kagi

Rule Path
Disallow

kukei.eu-bot

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mojeek

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.stevefenton.co.uk/sitemap.xml

Warnings

  • `disallowaitraining` is not a known field.