Log In Sign Up

maisondor.ro
robots.txt

Robots Exclusion Standard data for maisondor.ro

Resource Scan

Scan Details

Site Domain maisondor.ro
Base Domain maisondor.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-30T03:54:10+00:00
Next Scan 2026-03-30T03:54:10+00:00

Last Successful Scan

Scanned2025-05-11T13:14:09+00:00
URL https://maisondor.ro/robots.txt
Domain IPs 104.21.76.241, 172.67.202.79
Response IP 172.67.202.79
Found Yes
Hash 1575d8e35790ea37cd0f72353fd5a6f9d5f9a23e6ab39765e0bff89af7f70d6e
SimHash cd243a1a05f0

Groups

*

Rule Path
Disallow *filtrare*
Disallow *switch*
Disallow *?cat*
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /scripts/
Disallow /shell/
Disallow /stats/
Disallow /var/
Disallow /biocrm/
Disallow /vechi/
Disallow /themesetup/
Disallow /generated/
Disallow /modules/
Disallow *?smclient
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?SID=
Disallow /lib/
Disallow /*.php$
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*.git
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /contacts/
Disallow /newsletter/
Disallow /poll/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /catalog/product/gallery/
Disallow /quickview/index/view/path/
Disallow /*?parameter=true
Disallow /*?price=
Disallow /*?manufacturer=
Disallow /*?cat=
Disallow /*%26price%3D
Disallow /*?color=
Disallow /*%26color%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?dir=
Disallow /*%26dir%3D
Disallow /*?p=*
Disallow /*%26p%3D*
Back to top

Other Records

Field Value
sitemap https://www.maisondor.ro/pub/sitemap.xml
sitemap https://www.maisondor.ro/pub/sitemap_en.xml
Back to top

Comments

  • Filtre
  • Do not crawl common Magento technical folders
  • Do not crawl common Magento files
  • MAGENTO SEO IMPROVEMENTS
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl links with session IDs
  • Disable checkout & customer account
  • Disable Search pages
  • Common files
  • Disable sorting (Avoid duplicate content)
  • Disable version control folders and others
  • Paths (clean URLs)
Back to top