boughtonengineering.com
robots.txt
Robots Exclusion Standard data for boughtonengineering.com
Resource Scan
Scan Details
| Site Domain | boughtonengineering.com |
| Base Domain | boughtonengineering.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-11-18T13:48:55+00:00 |
| Next Scan | 2025-11-25T13:48:55+00:00 |
Last Successful Scan
| Scanned | 2025-11-02T23:29:30+00:00 |
| URL | https://boughtonengineering.com/robots.txt |
| Redirect | https://www.boughtonengineering.com/robots.txt |
| Redirect Domain | www.boughtonengineering.com |
| Redirect Base | boughtonengineering.com |
| Domain IPs | 194.164.31.242 |
| Redirect IPs | 194.164.31.242 |
| Response IP | 194.164.31.242 |
| Found | Yes |
| Hash | 768b35519b331741d7de15fbef966293b6e6b9620555101cd90152a17e1244e3 |
| SimHash | e618c4026edb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /product-filter |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /customer_home.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /side_bar.html |
| Disallow | /shop_layout.html |
| Disallow | /checkout_layout.html |
| Disallow | /checkout_cancelled_text.html |
| Disallow | /checkout_extra_info.html |
| Disallow | /invoice_footer_text.html |
| Disallow | /invoice_returns_details.html |
| Disallow | /setup_footer_text.html |
| Disallow | /register_page.html |
| Disallow | /users_home.html |
| Disallow | /Side_Bar_2.html |
| Disallow | /Sales.html |
| Disallow | /iphone_info.html |
| Disallow | /iphone_order.html |
| Disallow | /ebay_template.html |
| Disallow | /thanks.html |
| Disallow | /splash_page.html |
| Disallow | /checkout_fast_reg.html |
| Disallow | /bank_transfer.html |
| Disallow | /cash_on_delivery.html |
| Disallow | /application_pages.html |
| Disallow | /login_register_text.html |
| Disallow | /email_abandoned_cart.html |
| Disallow | /free_delivery.html |
| Disallow | /common_page_text_app.html |
| Disallow | /blog_private_text.html |
| Disallow | /blog_home_text.html |
| Disallow | /group_deal_email_signup.html |
| Disallow | /group_deal_email_success.html |
| Disallow | /group_deal_email_failed.html |
| Disallow | /group_deal_email_followup.html |
| Disallow | /group_deal_faq_text.html |
| Disallow | /business_card_intro_text.html |
| Disallow | /business_card_popup_text.html |
| Disallow | /thanks_failed.html |
| Disallow | /purchase_order.html |
| Disallow | /shop_product_layout.html |
| Disallow | /checkout_terms_and_conditions.html |
| Disallow | /cash_on_delivery_clone.html |
| Disallow | /PP_Registration_Stage_One.html |
| Disallow | /PP_Scheme_Introduction_Text.html |
| Disallow | /PP_Terms_and_Conditions.html |
| Disallow | /PP_Registration_Stage_Two.html |
| Disallow | /PP_Registration_Stage_Three.html |
| Disallow | /PP_New_Scheme_User_Email.html |
| Disallow | /user_delivery_addreses_text.html |
| Disallow | /email_purchase_event_download.html |
| Disallow | /Customers.html |
| Disallow | /Product_Range.html |
| Disallow | /email_user_payment_failed.html |
| Disallow | /newsletter_opt_in_confirmation.html |
| Disallow | /email_quote_comment.html |
| Disallow | /Front_End_Loader_FEL.html |
| Disallow | /Product_Range/Front_End_Loader_FEL.html |
| Disallow | /CareersOLD.html |
| Disallow | /About/CareersOLD.html |
| Disallow | /Timeline_App.html |
| Disallow | /email_quote_email_tracking.html |
| Disallow | /product_filter_default.html |
| Disallow | /Covid-19_Closure.html |
| Disallow | /paypal_commerce_screen_title.html |
| Disallow | /review_image_upload_terms_and_conditions.html |
| Disallow | /checkout_layout_continue_review_text.html |
| Disallow | /checkout_layout_confirm_text.html |
| Disallow | /checkout_layout_register_text.html |
| Disallow | /checkout_layout_delivery_methods_info.html |
| Disallow | /checkout_duties_paid_text.html |
| Disallow | /refer_a_friend_customer_area.html |
| Disallow | /sub_dealers_email_accept.html |
| Disallow | /sub_dealers_email_reject.html |
| Disallow | /sub_dealers_email_placed.html |
| Disallow | /sub_dealers_whole_dealer_email_placed.html |
| Disallow | /sub_dealer_thanks.html |
| Disallow | /rs_dealer_stock_csv_email.html |
| Disallow | /search*%26page%3D* |
rogerbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
dotbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
yandexbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
zumbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
riddler
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
spbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
blexbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
megaindex
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
bubing
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
domaincrawler
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
mauibot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
qwantify
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
openvas
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
adscanner
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
bpimagewalker
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
petalbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
seekport crawler
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
seekportbot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
klarnabot-pricewatcher
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
dataforseobot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
bytespider
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
geedoproductsearch
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /login.php |
| Disallow | /register.php |
| Disallow | /checkout.php |
| Disallow | /thanks.php |
| Disallow | /customer_home.php |
| Disallow | /includes/ |
| Disallow | /product-filter |
| Disallow | /*?*=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.boughtonengineering.com/sitemap.xml |
Comments