glamira.com.au
robots.txt

Robots Exclusion Standard data for glamira.com.au

Resource Scan

Scan Details

Site Domain glamira.com.au
Base Domain glamira.com.au
Scan Status Ok
Last Scan2024-06-07T07:09:12+00:00
Next Scan 2024-07-07T07:09:12+00:00

Last Scan

Scanned2024-06-07T07:09:12+00:00
URL https://glamira.com.au/robots.txt
Redirect https://www.glamira.com.au/robots.txt
Redirect Domain www.glamira.com.au
Redirect Base glamira.com.au
Domain IPs 13.236.11.198
Redirect IPs 104.81.138.33, 104.81.138.51, 2600:1417:3f::b81c:eb52, 2600:1417:3f::b81c:eb6a
Response IP 104.88.70.155
Found Yes
Hash 1d32e57ebf921e3ff6d2cfb4d7a9ad94c01abe957de297987ab083569e40c2dc
SimHash 51351b5287de

Groups

adsbot-google
*

Rule Path
Disallow /admin/
Disallow /secured2021/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /testcache/
Disallow /awin/
Disallow /forter/
Disallow /delivery_date/
Disallow /promo_extend/
Disallow /page_cache_public/
Disallow /page_cache/
Disallow /rest/
Disallow /relation/
Disallow /review/
Disallow /*/awin/
Disallow /*/forter/
Disallow /*/delivery_date/
Disallow /*/promo_extend/
Disallow /*/page_cache_public/
Disallow /*/page_cache/
Disallow /*/rest/
Disallow /*/relation/
Disallow /*/review/
Disallow /mysqlprocesses.php
Disallow /toolconvertcsv.php
Disallow /health_check.php
Disallow /memcachestat.php
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /xmlFeedExport.php
Disallow /buildcache.php
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /rev.txt
Disallow /*.php$
Disallow /*SID%3D
Disallow /*___store%3D
Disallow /*___SID%3D
Disallow /*___from_store%3D
Disallow /*limit%3D
Disallow /*product_list_order%3Dprice
Disallow /*amp%3D
Disallow /*mode%3Dlist
Disallow /*mode%3Dgrid
Disallow /*order%3Drelevance
Disallow /customcheckout/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /data-faq/
Disallow /*/customcheckout/
Disallow /*/checkout/
Disallow /*/onestepcheckout/
Disallow /*/customer/
Disallow /*/customer/account/
Disallow /*/customer/account/login/
Disallow /*/data-faq/
Disallow /override/catalog_ajax/recentviewed/
Disallow /sendfriend/product/send/
Disallow /catalog/product_compare/
Disallow /gpt3/
Disallow /googletagmanager/
Disallow /custom/geoip/
Disallow /*/override/catalog_ajax/recentviewed/
Disallow /*/sendfriend/product/send/
Disallow /*/catalog/product_compare/
Disallow /*/gpt3/
Disallow /*/googletagmanager/
Disallow /*/custom/geoip/
Disallow /captcha/
Disallow /captcha/refresh/
Disallow /*/*/*/
Disallow /en/*/*/*/
Disallow /ar/*/*/*/
Disallow /cn/*/*/*/
Disallow /es/*/*/*/
Disallow /fr/*/*/*/
Disallow /it/*/*/*/
Disallow /my/*/*/*/
Disallow /nl/*/*/*/
Disallow /pt/*/*/*/
Disallow /ru/*/*/*/
Disallow /tr/*/*/*/
Disallow /tw/*/*/*/
Allow /en/*/*/
Allow /ar/*/*/
Allow /cn/*/*/
Allow /es/*/*/
Allow /fr/*/*/
Allow /it/*/*/
Allow /my/*/*/
Allow /nl/*/*/
Allow /pt/*/*/
Allow /ru/*/*/
Allow /tr/*/*/
Allow /tw/*/*/
Allow /media/*
Allow /static/*
Allow /megamenu/*

Other Records

Field Value
sitemap https://www.glamira.com.au/sitemap.xml

Comments

  • Directories
  • Do not crawl Magento admin page
  • Do not crawl common Magento technical folders
  • Do not crawl unncessary page resources
  • Do not crawl common Magento files
  • Do not crawl links with session IDs
  • Paths (no clean URLs)
  • Do not crawl checkout and user account pages
  • Some ajax actions
  • Do not crawl seach pages and not-SEO optimized captcha link
  • Do not crawl filtered URLs with 2 or more filteres applied