brickshop.be
robots.txt

Robots Exclusion Standard data for brickshop.be

Resource Scan

Scan Details

Site Domain brickshop.be
Base Domain brickshop.be
Scan Status Ok
Last Scan2025-03-22T07:26:28+00:00
Next Scan 2025-04-21T07:26:28+00:00

Last Scan

Scanned2025-03-22T07:26:28+00:00
URL https://brickshop.be/robots.txt
Redirect https://www.brickshop.be/robots.txt
Redirect Domain www.brickshop.be
Redirect Base brickshop.be
Domain IPs 104.21.94.152, 172.67.137.104, 2606:4700:3034::6815:5e98, 2606:4700:3037::ac43:8968
Redirect IPs 104.21.94.152, 172.67.137.104, 2606:4700:3034::6815:5e98, 2606:4700:3037::ac43:8968
Response IP 172.67.137.104
Found Yes
Hash f1edba366de2b7010da203081d1f691a21e3fef884ec51de38a1395b9163ba2e
SimHash 0b2cd77421f9

Groups

*

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Disallow /xmlrpc/
Allow /templates/brickshop34/css
Allow /templates/brickshop34/images
Allow /templates/brickshop34/joomla_images
Allow /templates/brickshop34/mobile
Allow /components/com_virtuemart/js
Allow /components/com_virtuemart/themes/default/images
Allow /modules/mod_universal_ajaxlivesearch/themes/elegant/images/search_button
Allow /modules/mod_universal_ajaxlivesearch/engine
Allow /modules/mod_vm_accordion/themes/default/images
Allow /modules/mod_vm_accordion/js
Allow /components/com_virtuemart/shop_image
Allow /components/com_virtuemart/show_image_in_imgtag.php
Allow /media/mdb/lego_themes

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.brickshop.nl/index.php?option=com_xmap&sitemap=1&view=xml

Comments

  • 21