dionshop.gr
robots.txt

Robots Exclusion Standard data for dionshop.gr

Resource Scan

Scan Details

Site Domain dionshop.gr
Base Domain dionshop.gr
Scan Status Ok
Last Scan4/2/2025, 7:49:13 PM
Next Scan 5/2/2025, 7:49:13 PM

Last Scan

Scanned4/2/2025, 7:49:13 PM
URL https://dionshop.gr/robots.txt
Redirect https://www.dionshop.gr/robots.txt
Redirect Domain www.dionshop.gr
Redirect Base dionshop.gr
Domain IPs 104.21.85.27, 172.67.201.57, 2606:4700:3033::6815:551b, 2606:4700:3035::ac43:c939
Redirect IPs 104.21.85.27, 172.67.201.57, 2606:4700:3033::6815:551b, 2606:4700:3035::ac43:c939
Response IP 104.21.85.27
Found Yes
Hash cfca822e9c1008ae220c24e1277ded30c175a96a3e8444dc50b4da2428f93a8b
SimHash af26bd5103b1

Groups

*

Rule Path Comment
Disallow /404/ -
Disallow /app/ -
Disallow /cgi-bin/ -
Disallow /downloader/ -
Disallow /admin/ -
Disallow /errors/ -
Disallow /includes/ -
Disallow /lib/ -
Disallow /magento/ -
Disallow /media/captcha/ -
Disallow /media/customer/ -
Disallow /media/dhl/ -
Disallow /media/downloadable/ -
Disallow /media/import/ -
Disallow /media/pdf/ -
Disallow /media/sales/ -
Disallow /media/tmp/ -
Disallow /media/wysiwyg/ -
Disallow /media/xmlconnect/ -
Disallow /pkginfo/ -
Disallow /report/ -
Disallow /scripts/ -
Disallow /shell/ -
Disallow /stats/ -
Disallow /var/ -
Disallow /index.php/ -
Disallow /catalog/product_compare/ -
Disallow /catalog/category/view/ -
Disallow /catalog/product/gallery/ -
Disallow /catalogsearch/ -
Disallow /checkout/ -
Disallow /control/ -
Disallow /contacts/ -
Disallow /customer/ -
Disallow /customize/ -
Disallow /newsletter/ -
Disallow /poll/ -
Disallow /review/ -
Disallow /sendfriend/ -
Disallow /tag/ -
Disallow /wishlist/ -
Disallow /api.php -
Disallow /cron.php -
Disallow /cron.sh -
Disallow /error_log -
Disallow /install.php -
Disallow /LICENSE.html -
Disallow /LICENSE.txt -
Disallow /LICENSE_AFL.txt -
Disallow /STATUS.txt -
Disallow /get.php Magento 1.5+
Disallow /README.txt -
Disallow /RELEASE_NOTES.txt -
Disallow /cleanup.php -
Disallow /apc.php -
Disallow /memcache.php -
Disallow /phpinfo.php -
Disallow /*?dir* -
Disallow /*?dir=desc -
Disallow /*?dir=asc -
Disallow /*?limit=all -
Disallow /*?mode* -
Disallow /*.php$ -
Disallow /*?SID= -
Disallow /rss* -
Disallow /*PHPSESSID -

Other Records

Field Value
sitemap https://www.dionshop.gr/sitemap.xml

Comments

  • Website Sitemap
  • Crawlers Setup
  • Directories
  • Disallow: /js/
  • Disallow: /media/
  • Disallow: /media/catalog/
  • Disallow: /media/css/
  • Disallow: /media/css_secure/
  • Disallow: /media/js/
  • Disallow: /skin/
  • Paths (clean URLs)
  • Files
  • Do not index the general technical directories and files on a server
  • Do not crawl sub category pages that are sorted or filtered.
  • Paths (no clean URLs)
  • Disallow: /*.js$
  • Disallow: /*.css$

Warnings

  • 1 invalid line.