donebeforebrekky.com
robots.txt

Robots Exclusion Standard data for donebeforebrekky.com

Resource Scan

Scan Details

Site Domain donebeforebrekky.com
Base Domain donebeforebrekky.com
Scan Status Ok
Last Scan2026-02-24T23:41:26+00:00
Next Scan 2026-03-26T23:41:26+00:00

Last Scan

Scanned2026-02-24T23:41:26+00:00
URL https://donebeforebrekky.com/robots.txt
Domain IPs 104.21.70.186, 172.67.138.178, 2606:4700:3032::6815:46ba, 2606:4700:3035::ac43:8ab2
Response IP 172.67.138.178
Found Yes
Hash ac453772b3550890b134711592a21797f2856f2d9fa0d1bf843946dd07291f6c
SimHash 48045a30ef77

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://donebeforebrekky.com/sitemap.xml