trycharcoal.com
robots.txt

Robots Exclusion Standard data for trycharcoal.com

Resource Scan

Scan Details

Site Domain trycharcoal.com
Base Domain trycharcoal.com
Scan Status Ok
Last Scan2025-11-21T00:35:12+00:00
Next Scan 2025-12-05T00:35:12+00:00

Last Scan

Scanned2025-11-21T00:35:12+00:00
URL https://trycharcoal.com/robots.txt
Domain IPs 104.26.10.37, 104.26.11.37, 172.67.75.117, 2606:4700:20::681a:a25, 2606:4700:20::681a:b25, 2606:4700:20::ac43:4b75
Response IP 172.67.75.117
Found Yes
Hash cb985ec371271ef235114539ca48a08fa0ed7f99cdd6749f3a0511c5a3946237
SimHash aa7d4ec2cc01

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /dashboard/
Disallow /account/
Disallow /settings/
Allow /sitemap.xml
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.ico

Other Records

Field Value
sitemap https://trycharcoal.com/sitemap.xml

Comments

  • https://trycharcoal.com/robots.txt
  • Allow crawling of all content
  • Prevent crawling of non-public routes
  • Allow essential files
  • Sitemap location