cfhoney.com
robots.txt

Robots Exclusion Standard data for cfhoney.com

Resource Scan

Scan Details

Site Domain cfhoney.com
Base Domain cfhoney.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-23T11:41:14+00:00
Next Scan 2026-01-21T11:41:14+00:00

Last Successful Scan

Scanned2024-03-09T16:50:51+00:00
URL https://cfhoney.com/robots.txt
Domain IPs 104.21.11.208, 172.67.192.163, 2606:4700:3032::ac43:c0a3, 2606:4700:3036::6815:bd0
Response IP 172.67.192.163
Found Yes
Hash f2b483860d4c85fb9465e6ef05fcc6f0078c9fbe4bd29604b35f7b0e9c315c63
SimHash 181cd946ea10

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

*

Rule Path
Disallow
Disallow /cgi-bin/