bittersweetcreative.com
robots.txt

Robots Exclusion Standard data for bittersweetcreative.com

Resource Scan

Scan Details

Site Domain bittersweetcreative.com
Base Domain bittersweetcreative.com
Scan Status Ok
Last Scan2025-06-03T10:32:08+00:00
Next Scan 2025-07-03T10:32:08+00:00

Last Scan

Scanned2025-06-03T10:32:08+00:00
URL https://bittersweetcreative.com/robots.txt
Redirect https://www.bittersweetcreative.com/robots.txt
Redirect Domain www.bittersweetcreative.com
Redirect Base bittersweetcreative.com
Domain IPs 104.21.0.249, 172.67.151.129, 2606:4700:3031::ac43:9781, 2606:4700:3033::6815:f9
Redirect IPs 104.21.0.249, 172.67.151.129, 2606:4700:3031::ac43:9781, 2606:4700:3033::6815:f9
Response IP 172.67.151.129
Found Yes
Hash 90f746124eed9adc8ed772652c3cd2c046f0c5aa62a6c9fa05bbb09e5ebbc590
SimHash e15419664f36

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bittersweetcreative.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.bittersweetcreative.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow ChatGPT bot, as there's no benefit to allowing it to index your site