recipenames.com
robots.txt

Robots Exclusion Standard data for recipenames.com

Resource Scan

Scan Details

Site Domain recipenames.com
Base Domain recipenames.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-09T13:55:12+00:00
Next Scan 2025-08-16T13:55:12+00:00

Last Successful Scan

Scanned2025-08-01T13:54:55+00:00
URL https://recipenames.com/robots.txt
Redirect https://toolguyd.com/robots.txt
Redirect Domain toolguyd.com
Redirect Base toolguyd.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.94.231, 172.67.141.76, 2606:4700:3034::ac43:8d4c, 2606:4700:3036::6815:5ee7
Response IP 172.67.141.76
Found Yes
Hash 54aade01f726667ac430f84daf04fabc36192b36d8f922637c3e7bd6de39c488
SimHash 6a79c860c1b1

Groups

mj12bot
yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/

gptbot
chatgpt-user
ccbot

Rule Path
Disallow /