Log In Sign Up

glamira.be
robots.txt

Robots Exclusion Standard data for glamira.be

Resource Scan

Scan Details

Site Domain glamira.be
Base Domain glamira.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-15T11:12:32+00:00
Next Scan 2026-01-13T11:12:32+00:00

Last Successful Scan

Scanned2025-02-25T01:16:54+00:00
URL https://glamira.be/robots.txt
Redirect https://www.glamira.be/robots.txt
Redirect Domain www.glamira.be
Redirect Base glamira.be
Domain IPs 18.159.72.130
Redirect IPs 23.32.29.98, 23.32.29.99, 2600:1413:b000:6::17d5:2bc4, 2600:1413:b000:6::17d5:2bc6
Response IP 23.59.168.98
Found Yes
Hash 6cc42daf52625dbc519e2848b9342ecaf097453e837493f86fdc0f9d829bc27e
SimHash 41351b5287df

Groups

adsbot-google
*

Rule Path
Disallow /admin/
Disallow /secured2021/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /testcache/
Disallow /awin/
Disallow /forter/
Disallow /delivery_date/
Disallow /promo_extend/
Disallow /page_cache_public/
Disallow /page_cache/
Disallow /rest/
Disallow /relation/
Disallow /review/
Disallow /*/awin/
Disallow /*/forter/
Disallow /*/delivery_date/
Disallow /*/promo_extend/
Disallow /*/page_cache_public/
Disallow /*/page_cache/
Disallow /*/rest/
Disallow /*/relation/
Disallow /*/review/
Disallow /mysqlprocesses.php
Disallow /toolconvertcsv.php
Disallow /health_check.php
Disallow /memcachestat.php
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /xmlFeedExport.php
Disallow /buildcache.php
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /rev.txt
Disallow /*.php$
Disallow /*SID%3D
Disallow /*___store%3D
Disallow /*___SID%3D
Disallow /*___from_store%3D
Disallow /*limit%3D
Disallow /*product_list_order%3Dprice
Disallow /*amp%3D
Disallow /*mode%3Dlist
Disallow /*mode%3Dgrid
Disallow /*order%3Drelevance
Disallow /customcheckout/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /data-faq/
Disallow /*/customcheckout/
Disallow /*/checkout/
Disallow /*/onestepcheckout/
Disallow /*/customer/
Disallow /*/customer/account/
Disallow /*/customer/account/login/
Disallow /*/data-faq/
Disallow /override/catalog_ajax/recentviewed/
Disallow /sendfriend/product/send/
Disallow /catalog/product_compare/
Disallow /gpt3/
Disallow /googletagmanager/
Disallow /custom/geoip/
Disallow /*/override/catalog_ajax/recentviewed/
Disallow /*/sendfriend/product/send/
Disallow /*/catalog/product_compare/
Disallow /*/gpt3/
Disallow /*/googletagmanager/
Disallow /*/custom/geoip/
Disallow /captcha/
Disallow /captcha/refresh/
Disallow /*/*/*/
Disallow /en/*/*/*/
Disallow /ar/*/*/*/
Disallow /cn/*/*/*/
Disallow /es/*/*/*/
Disallow /fr/*/*/*/
Disallow /it/*/*/*/
Disallow /my/*/*/*/
Disallow /nl/*/*/*/
Disallow /pt/*/*/*/
Disallow /ru/*/*/*/
Disallow /tr/*/*/*/
Disallow /tw/*/*/*/
Allow /en/*/*/
Allow /ar/*/*/
Allow /cn/*/*/
Allow /es/*/*/
Allow /fr/*/*/
Allow /it/*/*/
Allow /my/*/*/
Allow /nl/*/*/
Allow /pt/*/*/
Allow /ru/*/*/
Allow /tr/*/*/
Allow /tw/*/*/
Allow /media/*
Allow /static/*
Allow /megamenu/*

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://www.glamira.be/sitemap.xml
sitemap https://www.glamira.be/media/sitemap/glbe_fr/sitemap.xml
Back to top

Comments

  • Directories
  • Do not crawl Magento admin page
  • Do not crawl common Magento technical folders
  • Do not crawl unncessary page resources
  • Do not crawl common Magento files
  • Do not crawl links with session IDs
  • Paths (no clean URLs)
  • Do not crawl checkout and user account pages
  • Some ajax actions
  • Do not crawl seach pages and not-SEO optimized captcha link
  • Do not crawl filtered URLs with 2 or more filteres applied
  • Delay the GPTBot
Back to top