Log In Sign Up

better-canvas.com
robots.txt

Robots Exclusion Standard data for better-canvas.com

Resource Scan

Scan Details

Site Domain better-canvas.com
Base Domain better-canvas.com
Scan Status Ok
Last Scan2026-03-18T02:04:32+00:00
Next Scan 2026-03-25T02:04:32+00:00

Last Scan

Scanned2026-03-18T02:04:32+00:00
URL https://better-canvas.com/robots.txt
Redirect https://www.better-canvas.com/robots.txt
Redirect Domain www.better-canvas.com
Redirect Base better-canvas.com
Domain IPs 104.21.15.241, 172.67.208.211, 2606:4700:3031::6815:ff1, 2606:4700:3033::ac43:d0d3
Redirect IPs 104.21.15.241, 172.67.208.211, 2606:4700:3031::6815:ff1, 2606:4700:3033::ac43:d0d3
Response IP 172.67.208.211
Found Yes
Hash ad4d3d970cc906bc16af664204558ab1da671428eff6459f65811422ca512e08
SimHash 254b9b53e590

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /
Disallow /admin/
Disallow /private/
Disallow /temp/
Disallow /logs/
Disallow /*.log$
Disallow /backup/
Disallow /config/
Disallow /.git/
Disallow /.env
Disallow /node_modules/
Allow /css/
Allow /js/
Allow /images/
Allow /assets/
Allow /fonts/
Allow /*.css$
Allow /*.js$
Allow /*.png$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /*.svg$
Allow /*.ico$
Allow /*.webp$
Allow /*.woff$
Allow /*.woff2$
Allow /*.ttf$
Allow /download
Allow /features
Allow /themes
Allow /tutorials
Allow /faq
Allow /contact

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.better-canvas.com/sitemap.xml
Back to top

Comments

  • Robots.txt for Better Canvas Resources Website
  • https://www.better-canvas.com/robots.txt
  • Last updated: 2025-01-28
  • Sitemap location
  • Crawl-delay for general bots
  • Specific directives for major search engines
  • Block access to sensitive files and directories
  • Allow access to important static resources
  • Explicitly allow important pages for Better Canvas
  • Host directive (preferred domain)
Back to top

Warnings

  • `host` is not a known field.
Back to top