hitchweb.com
robots.txt

Robots Exclusion Standard data for hitchweb.com

Resource Scan

Scan Details

Site Domain hitchweb.com
Base Domain hitchweb.com
Scan Status Ok
Last Scan2026-02-01T07:22:38+00:00
Next Scan 2026-03-03T07:22:38+00:00

Last Scan

Scanned2026-02-01T07:22:38+00:00
URL https://hitchweb.com/robots.txt
Redirect https://www.hitchweb.com/robots.txt
Redirect Domain www.hitchweb.com
Redirect Base hitchweb.com
Domain IPs 104.21.70.147, 172.67.136.190, 2606:4700:3035::ac43:88be, 2606:4700:3036::6815:4693
Redirect IPs 104.21.70.147, 172.67.136.190, 2606:4700:3035::ac43:88be, 2606:4700:3036::6815:4693
Response IP 172.67.136.190
Found Yes
Hash 8e7cc6d0faae545b1cbee46984b27deaaf09720add81f6bc2fa2fdf1891859c3
SimHash 10be9e72b951

Groups

*

Rule Path
Disallow /_staging/
Disallow /_mirror/
Disallow /login
Disallow /shopping_cart
Disallow /shipping-and-returns
Disallow /registration
Disallow /page/price-match
Disallow /page/privacy-policy
Disallow /page/welcome
Disallow /page/terms-and-conditions
Disallow /application/
Allow /application/glue/themes/*/css/
Allow /application/modules/catalog/assets/
Allow /application/modules/core/assets/
Allow /application/modules/shopping/assets/
Disallow /charts/
Disallow /config/
Disallow /css/
Disallow /digital/
Disallow /features/
Disallow /inc/
Disallow /installation/
Disallow /js/
Disallow /mobile_resources/
Disallow /muploads/
Disallow /plesk-stat/
Disallow /pronto_uploads/
Disallow /related/
Disallow /system/
Disallow /assist
Disallow /assist*
Disallow /assist/
Disallow /logout
Disallow /my_account
Disallow /my_account*
Disallow /my_account/web_orders
Disallow /my_account/open_orders
Disallow /my_account/invoiced_orders
Disallow /my_account/item_purchase_history
Disallow /my_account/favourites
Disallow /my_account/ar_details/get_ar
Disallow /my_account/quotes
Disallow /wishlists
Disallow /account_payments/
Disallow /admin
Disallow /admin*
Disallow /admin.php
Disallow /admin.php/admin/
Disallow /admin.php/admin/admin_login
Disallow /_dev/
Disallow /_dev_test/
Disallow /_devtest/
Disallow /vid/*
Disallow /index.php/custom_search/*
Disallow /blog/rss
Disallow /blog/category/
Disallow /page/hw_footer_about
Disallow /page/footer-message
Disallow /page/homepage-blog-feed
Disallow /page/user-registration-success
Disallow /page/Chat
Disallow /page/header-free-shipping
Disallow /page/Free-Shipping-Notice
Disallow /page/fireside-feed-archives
Disallow /page/search-page-footer
Disallow /page/footer-links-1
Disallow /page/footer-links-2
Disallow /page/home-popular-categories
Disallow /page/search-results-page-foot
Disallow /page/search-page-header
Disallow /page/hitch_searcher_header
Disallow /page/order_email_header
Disallow /page/hitch_searcher
Disallow /page/order_email_footer
Disallow /page/Cargo-accessory-categorie
Disallow /page/non-index-archive
Disallow /page/installer-location
Disallow /page/giveaway
Disallow /page/brands-we-support-backup
Disallow /page/rhino-rack-inline
Disallow /page/rhino-rack-no-results
Disallow /page/qr-promo
Disallow /page/home-page-backup
Disallow /page/mh_rhino_rack
Disallow /page/mh_reese
Disallow /page/mh_curt_manufacturing
Disallow /page/mh_b%26w_trailer_hitches
Disallow /page/mh_Hidden_Hitch
Disallow /page/mh_Tekonsha
Disallow /page/mh_Draw-Tite
Disallow /page/mh_Dexter_Axle
Disallow /page/mh_Atwood_Mobile_Products
Disallow /page/mh_Bargman
Disallow /page/mh_Blue_Ox
Disallow /page/mh_Bulldog
Disallow /page/mh_California_Immobilizer
Disallow /page/mh_Carhartt
Disallow /page/mh_CIPA_Mirrors
Disallow /page/mh_Cloud-Rider
Disallow /page/mh_Convert-A-Ball
Disallow /page/mh_Custer_Products
Disallow /page/mh_Demco
Disallow /page/mh_Demco_Hijacker
Disallow /page/mh_Equalizer
Disallow /page/mh_Fastway
Disallow /page/mh_Firestone
Disallow /page/mh_Fulton
Disallow /page/mh_Happijac
Disallow /page/mh_Hopkins_Mfg
Disallow /page/mh_One_Mount_System
Disallow /page/mh_Master_Lock
Disallow /page/mh_Pilot_Automotive
Disallow /page/mh_Pro_Series
Disallow /page/mh_PullRite
Disallow /page/mh_Rage_Power_Sports
Disallow /page/mh_Rapid_Hitch
Disallow /page/vsm-search-footer
Disallow /page/mh_Roadmaster_Inc
Disallow /page/mh_Swagman
Disallow /page/mh_Torklift_International
Disallow /page/mh_Tow_Ready
Disallow /page/mh_TES
Disallow /page/mh_Trailermate
Disallow /page/mh_Trimax_Locks
Disallow /page/mh_TRP_International
Disallow /page/mh_Ultra_Fab
Disallow /page/mh_Smart_Solutions
Disallow /page/mh_Valterra_Products
Disallow /page/mh_Wesbar
Disallow /page/mh_Towing_Alternatives
Disallow /page/mh_Tite-Lok
Disallow /page/mh_Titan
Disallow /page/mh_Rola
Disallow /page/mh_Rock_Tamers_LLC
Disallow /page/mh_PopUp_Towing_Products
Disallow /page/mh_Pollak
Disallow /page/mh_Littelfuse
Disallow /page/mh_Knockout_Decals
Disallow /page/mh_JT%26T_Products
Disallow /page/mh_Holland_Hitch
Disallow /page/mh_Highland
Disallow /page/mh_East_Penn_Mfg
Disallow /page/mh_Dynaline_Industries
Disallow /page/mh_Classic_Accessories
Disallow /page/mh_Buyers_Products
Disallow /page/mh_Blaylock_Industries
Disallow /page/mh_Arrow_Radio
Disallow /category/alfr
Disallow /category/acur
Disallow /category/audi
Disallow /category/bmw
Disallow /category/buic
Disallow /category/cadi
Disallow /category/chev
Disallow /category/chry
Disallow /category/dodg
Disallow /category/fiat
Disallow /category/ford
Disallow /category/gmc
Disallow /category/humm
Disallow /category/hond
Disallow /category/infi
Disallow /category/jagu
Disallow /category/jeep
Disallow /category/kia
Disallow /category/land
Disallow /category/lexu
Disallow /category/linc
Disallow /category/mazd
Disallow /category/mery
Disallow /category/merc
Disallow /category/mini
Disallow /category/mits
Disallow /category/niss
Disallow /category/olds
Disallow /category/plym
Disallow /category/ram
Disallow /category/pont
Disallow /category/pors
Disallow /category/satu
Disallow /category/saab
Disallow /category/scio
Disallow /category/smar
Disallow /category/suba
Disallow /category/suzu
Disallow /category/tes
Disallow /category/toyo
Disallow /category/volk
Disallow /category/volv
Disallow /category/infi
Disallow /category/hyun
Disallow /category/isuz
Disallow /page/get-to-know-us
Disallow /page/payment-delay-notice
Disallow /page/home-5-sub-promo
Disallow /page/towing-recreation-brands
Disallow /page/cequent-towing-products
Disallow /page/click-to-chat
Disallow /page/customer-reviews
Disallow /page/login-failure
Disallow /page/home-3-features
Disallow /page/footer-links-1
Disallow /page/footer-links-2
Disallow /page/footer-links-3
Disallow /page/footer-links-4
Disallow /page/footer-promo-section
Disallow /page/footer-social-media
Disallow /page/hitchwiki-our-towing-glossary
Disallow /page/home-2-category
Disallow /page/lifestyle-icons
Disallow /page/checkout-matching-brand
Disallow /page/mega-camper
Disallow /page/mega-jeep
Disallow /page/mega-outdoors
Disallow /page/mega-rv
Disallow /page/mega-towing
Disallow /page/mega-trailer
Disallow /page/mega-truck
Disallow /page/header-aries-automotive
Disallow /page/header-arrow-radio
Disallow /page/header-atwood-mobile-products
Disallow /page/header-avital
Disallow /page/header-bw-trailer-hitches
Disallow /page/header-bargman
Disallow /page/header-blaylock-industries
Disallow /page/header-blue-ox
Disallow /page/header-bulldog
Disallow /page/header-buyers-products
Disallow /page/header-california-immobilizer
Disallow /page/header-carhartt
Disallow /page/header-cipa-mirrors
Disallow /page/header-classis-accessories
Disallow /page/header-cloud-rider
Disallow /page/header-convert-a-ball
Disallow /page/header-curt
Disallow /page/header-custer-products
Disallow /page/header-custom-flow
Disallow /page/header-deezee
Disallow /page/header-demco
Disallow /page/header-demco-hijacker
Disallow /page/header-dexter-axle
Disallow /page/header-draw-tite
Disallow /page/header-dynaline-industries
Disallow /page/header-east-penn-mfg
Disallow /page/header-equalizer
Disallow /page/header-fastway
Disallow /page/header-firestone
Disallow /page/header-fulton
Disallow /page/header-happijac
Disallow /page/header-hidden-hitch
Disallow /page/header-highland
Disallow /page/header-holland-hitch
Disallow /page/header-hopkins-mfg
Disallow /page/header-jt-t-products
Disallow /page/header-knockout-decals
Disallow /page/header-littelfuse
Disallow /page/header-master-lock
Disallow /page/header-meyer
Disallow /page/header-one-mount-system
Disallow /page/header-phoenix-usa
Disallow /page/header-pilot-automotive
Disallow /page/header-pollak
Disallow /page/header-popup-towing-products
Disallow /page/header-pro-series
Disallow /page/header-pullrite
Disallow /page/header-rage-power-sports
Disallow /page/header-rapid-hitch
Disallow /page/header-reese
Disallow /page/header-rhino-rack
Disallow /page/header-roadmaster-inc
Disallow /page/header-rock-tamers-llc
Disallow /page/header-rola
Disallow /page/header-smart-solutions
Disallow /page/header-stromberg
Disallow /page/header-swagman
Disallow /page/header-tekonsha
Disallow /page/towing-electrical-system
Disallow /page/header-titan
Disallow /page/header-tike-lok
Disallow /page/header-torklift-international
Disallow /page/header-tow-rax
Disallow /page/header-towing-alternatives
Disallow /page/header-tow-ready
Disallow /page/header-trailermate
Disallow /page/header-trimax-locks
Disallow /page/header-trp-international
Disallow /page/header-ultra-fab
Disallow /page/header-valterra-products
Disallow /page/header-warn
Disallow /page/header-waspcam
Disallow /page/header-wesbar
Disallow /page/order-confirmation-email-footer
Disallow /page/order-confirmation-email-header
Disallow /page/your-site-is-secure-right
Disallow /page/promo-section-2
Disallow /page/punchout2go-success
Disallow /page/qr-promo
Disallow /page/info
Disallow /page/quote-success
Disallow /page/rhino-rack
Disallow /page/rhino-rack-no-results
Disallow /page/search-page-footer
Disallow /page/what-should-i-know
Disallow /page/testing-for-debugg
Disallow /page/user-registration-success
Disallow /page/welcome

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /