toolsxl.nl
robots.txt

Robots Exclusion Standard data for toolsxl.nl

Resource Scan

Scan Details

Site Domain toolsxl.nl
Base Domain toolsxl.nl
Scan Status Ok
Last Scan2024-09-23T14:24:18+00:00
Next Scan 2024-10-23T14:24:18+00:00

Last Scan

Scanned2024-09-23T14:24:18+00:00
URL https://toolsxl.nl/robots.txt
Redirect https://www.toolsxl.nl/robots.txt
Redirect Domain www.toolsxl.nl
Redirect Base toolsxl.nl
Domain IPs 185.220.174.139, 2a06:2ec0:ded1:1:0:2:9824:1
Redirect IPs 185.220.174.139, 2a06:2ec0:ded1:1:0:2:9824:1
Response IP 185.220.174.139
Found Yes
Hash 33268802b764ad8a349fe30728e28d78f91122e01b8deb39913338d50bb5b472
SimHash 027a5112bc10

Groups

*

Rule Path
Disallow /account.php
Disallow /account_discount_coupons.php
Disallow /account_edit.php
Disallow /account_history.php
Disallow /account_history_info.php
Disallow /account_history_offers.php
Disallow /account_newsletters.php
Disallow /account_notifications.php
Disallow /account_password.php
Disallow /address_book.php
Disallow /address_book_process.php
Disallow /advanced_search.php
Disallow /advanced_search_result.php
Disallow /az_print_catalog.php
Disallow /banned.php
Disallow /checkout_confirmation.php
Disallow /checkout_payment.php
Disallow /checkout_payment_address.php
Disallow /checkout_process.php
Disallow /checkout_shipping.php
Disallow /checkout_shipping_address.php
Disallow /checkout_success.php
Disallow /cookie_usage.php
Disallow /create_account.php
Disallow /create_account_success.php
Disallow /download.php
Disallow /idealm.php
Disallow /idealm_error.php
Disallow /info_login.php
Disallow /info_shopping_cart.php
Disallow /login.php
Disallow /logoff.php
Disallow /mail_html_admin.css
Disallow /mail_html_catalog.css
Disallow /my_points.php
Disallow /my_points_help.php
Disallow /no_access.php
Disallow /password_forgotten.php
Disallow /popup_image.php
Disallow /product_info_before_tabs.php
Disallow /product_info_validation.php
Disallow /product_question_tab.php
Disallow /product_reviews_tab.php
Disallow /product_questions_write.php
Disallow /shopping_cart.php
Disallow /ssl_check.php
Disallow /tell_a_friend.php
Disallow /index_new.php
Disallow /specials_new.php
Disallow /shopping/

plukkie

Rule Path
Disallow /

riddler

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

megaindex.ru
megaindex.ru
megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

toweyabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

inoopabot/1.0

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

bubing

Rule Path
Disallow /

barkrowler/0.7

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.toolsxl.nl/sitemap_all_products.php
sitemap https://www.toolsxl.nl/sitemap_categories.php
sitemap https://www.toolsxl.nl/sitemap_manufacturers.php
sitemap https://www.toolsxl.nl/sitemap_products.php
sitemap https://www.toolsxl.nl/sitemap_accessoires.php

Comments

  • domainreanimator
  • https://megaindex.com/crawler
  • Backlink Analysis
  • Toweya.com bot - abuse@toweya.net - 2017-04-25
  • http://OpenLinkProfiler.org/bot
  • http://commoncrawl.org/big-picture/frequently-asked-questions/
  • https://www.qwant.com/