Log In Sign Up

celebrationgiftware.com.au
robots.txt

Robots Exclusion Standard data for celebrationgiftware.com.au

Resource Scan

Scan Details

Site Domain celebrationgiftware.com.au
Base Domain celebrationgiftware.com.au
Scan Status Ok
Last Scan2026-03-03T04:32:25+00:00
Next Scan 2026-04-02T04:32:25+00:00

Last Scan

Scanned2026-03-03T04:32:25+00:00
URL https://celebrationgiftware.com.au/robots.txt
Domain IPs 104.21.90.99, 172.67.155.145, 2606:4700:3031::ac43:9b91, 2606:4700:3037::6815:5a63
Response IP 104.21.90.99
Found Yes
Hash a9d0fc52a70d57b3accb972e211922a49cd1239adf8105b5df1a06aeff721028
SimHash 69141940c2da

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

bingbot
gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

*

Rule Path
Disallow /checkout/
Disallow /customer/
Disallow /wishlist/
Disallow /catalogsearch/
Disallow /review/
Disallow /newsletter/
Disallow /compare/
Disallow /contact/
Disallow /*?dir*
Disallow /*?order*
Disallow /*?price=
Disallow /*?p=
Disallow /*?SID=
Disallow /reviews?limit=*
Disallow /reviews?*
Disallow /*.php$
Disallow /*.js$
Disallow /*.css$
Disallow /*.cgi$
Back to top

Other Records

Field Value
sitemap https://celebrationgiftware.com.au/media/sitemap_au.xml
sitemap https://celebrationgiftware.com.au/sitemap_au.xml
sitemap https://celebrationgiftware.com.au/media/sitemap_au.xml
Back to top

Comments

  • ---------------------------------------------
  • Allow Googlebot
  • Allow Bingbot with crawl delay
  • ---------------------------------------------
  • Block Unnecessary Bots
  • ---------------------------------------------
  • Disallow Sensitive Magento Paths
  • Disallow sorting/filtering URLs
  • Disallow certain file types
  • ---------------------------------------------
  • Sitemap URL
Back to top