Log In Sign Up

smartoys.be
robots.txt

Robots Exclusion Standard data for smartoys.be

Resource Scan

Scan Details

Site Domain smartoys.be
Base Domain smartoys.be
Scan Status Ok
Last Scan2026-02-03T18:28:06+00:00
Next Scan 2026-03-05T18:28:06+00:00

Last Scan

Scanned2026-02-03T18:28:06+00:00
URL https://smartoys.be/robots.txt
Domain IPs 104.26.4.184, 104.26.5.184, 172.67.70.151, 2606:4700:20::681a:4b8, 2606:4700:20::681a:5b8, 2606:4700:20::ac43:4697
Response IP 172.67.70.151
Found Yes
Hash c0a515ce55605ca365b54123b8b8bbe92efb153cd4befd2915dcbfc30106d25d
SimHash 7c057053ce9f

Groups

*

Rule Path
Disallow /catalog/includes
Disallow /catalog/cgi-bin
Disallow /catalog/account.php
Disallow /catalog/account_edit.php
Disallow /catalog/account_history.php
Disallow /catalog/account_history_info.php
Disallow /catalog/account_password.php
Disallow /catalog/add_checkout_success.php
Disallow /catalog/address_book.php
Disallow /catalog/address_book_process.php
Disallow /catalog/advanced_search.php
Disallow /catalog/checkout_confirmation.php
Disallow /catalog/checkout_payment.php
Disallow /catalog/checkout_payment_address.php
Disallow /catalog/checkout_process.php
Disallow /catalog/checkout_shipping.php
Disallow /catalog/checkout_shipping_address.php
Disallow /catalog/checkout_success.php
Disallow /catalog/contact_bean.php
Disallow /catalog/cookie_usage.php
Disallow /catalog/create_account.php
Disallow /catalog/create_account_success.php
Disallow /catalog/login.php
Disallow /catalog/password_forgotten.php
Disallow /catalog/popup_image.php
Disallow /catalog/shopping_cart.php
Disallow /catalog/product_reviews_write.php
Back to top

Other Records

Field Value
sitemap https://www.smartoys.be/catalog/sitemapindex.xml
Back to top

Comments

  • These settings will keep spiders from indexing your unwanted pages
  • This assumes that your OSC install is in your web site's CATALOG directory
  • ie: http://www.yoursite.com/catalog/index.php <- Use if this brings up your OSC main page
Back to top