Log In Sign Up

brekz.be
robots.txt

Robots Exclusion Standard data for brekz.be

Resource Scan

Scan Details

Site Domain brekz.be
Base Domain brekz.be
Scan Status Ok
Last Scan2024-05-19T14:09:39+00:00
Next Scan 2024-06-02T14:09:39+00:00

Last Scan

Scanned2024-05-19T14:09:39+00:00
URL https://www.brekz.be/robots.txt
Domain IPs 104.26.14.118, 104.26.15.118, 172.67.73.137, 2606:4700:20::681a:e76, 2606:4700:20::681a:f76, 2606:4700:20::ac43:4989
Response IP 172.67.73.137
Found Yes
Hash 50052c08a361373ca578793108bf571315c967fa15ec33d187e3119b2b9e71ce
SimHash aa14b5536d44

Groups

*

Rule Path
Allow /modules/*.png
Allow /modules/*.jpg
Allow /modules/*.gif
Allow /modules/*.js
Allow /modules/*.css
Disallow /*classes/
Disallow /*config/
Disallow /*download/
Disallow /*mails/
Disallow /*modules/
Disallow /*translations/
Disallow /*tools/
Disallow /administrator
Disallow /cookie-informatie
Disallow /*?n=*
Disallow /addresses
Disallow /order-history
Disallow /identity
Disallow /mijn-account
Disallow /index.php?controller=orders-slip
Disallow /quick-order
Back to top

Other Records

Field Value
sitemap https://www.brekz.be/2_be_0_sitemap.xml
Back to top

Comments

  • robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • Allow module assets access
  • Directories
  • Custom disallow
  • Dynamic content below
  • --------------------------
  • Per shop disallowed directories
  • Sitemap
Back to top