thecanvasfactory.com.au
robots.txt

Robots Exclusion Standard data for thecanvasfactory.com.au

Resource Scan

Scan Details

Site Domain thecanvasfactory.com.au
Base Domain thecanvasfactory.com.au
Scan Status Ok
Last Scan2025-09-23T12:39:50+00:00
Next Scan 2025-10-23T12:39:50+00:00

Last Scan

Scanned2025-09-23T12:39:50+00:00
URL https://thecanvasfactory.com.au/robots.txt
Redirect https://www.thecanvasfactory.com.au/robots.txt
Redirect Domain www.thecanvasfactory.com.au
Redirect Base thecanvasfactory.com.au
Domain IPs 172.66.40.185, 172.66.43.71, 2606:4700:3108::ac42:28b9, 2606:4700:3108::ac42:2b47
Redirect IPs 172.66.40.185, 172.66.43.71, 2606:4700:3108::ac42:28b9, 2606:4700:3108::ac42:2b47
Response IP 172.66.40.185
Found Yes
Hash 998f479e86721a8bd4f6b6ffc64feea78f06aeb3907632c599de6aa38320124d
SimHash 698712756577

Groups

*

Rule Path
Disallow /*dispatch%3Ddebug*
Disallow /*?dispatch=debug
Disallow /app/
Disallow /design/backend/
Disallow /design/themes/shinetech/
Disallow /store_closed.html
Disallow /Css/CanvasApp.css.min.css
Disallow /Css/CanvasApp.mobile.css.min.css
Disallow /scripts/Canvasplus/canvasapp.js
Disallow /scripts/Canvasplus/canvasapp.messenger.js
Disallow /blog/tag/
Disallow /blog/post-formats/
Disallow /Home/
Disallow /catalog/FotoliaCatImages
Disallow /Catalog/FotoliaSearch
Disallow /canvas-art-prints-detail/
Disallow /cdn-cgi/l/email-protection
Allow /.js$
Allow /.css$
Allow /images/
Allow /products/
Allow /categories/
Allow /blog/
Allow /pages/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot
msnbotmedia

Rule Path
Allow /

adsbot-google
duckduckbot
yahoo! slurp
baiduspider
yandexbot
applebot
facebot
twitterbot
pinterestbot
linkedinbot
slackbot-linkexpanding
whatsapp
telegrambot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.thecanvasfactory.com.au/sitemap.xml

Comments

  • BLOCK debug/admin/backend
  • CanvasApp: files loaded by ajax
  • Blog exclusions
  • Custom disallows
  • ALLOW all public assets & pages
  • Googlebot (web & image)
  • Bingbot & MSN
  • Other crawlers
  • Optional throttle
  • Crawl-delay: 5