benekeith.com
robots.txt

Robots Exclusion Standard data for benekeith.com

Resource Scan

Scan Details

Site Domain benekeith.com
Base Domain benekeith.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-01T16:12:04+00:00
Next Scan 2025-10-30T16:12:04+00:00

Last Successful Scan

Scanned2023-12-18T09:50:49+00:00
URL https://benekeith.com/robots.txt
Redirect https://www.benekeith.com/robots.txt
Redirect Domain www.benekeith.com
Redirect Base benekeith.com
Domain IPs 96.17.96.15, 96.17.96.20
Redirect IPs 96.17.96.15, 96.17.96.20
Response IP 125.56.219.2
Found Yes
Hash df3571131dd4fe7b2dfd45d6e442f800dc5c4abfa61527c211d73b04e9d8899d
SimHash 4040d110c771

Groups

twitterbot

Rule Path
Allow *

*

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /