mbusa.com
robots.txt

Robots Exclusion Standard data for mbusa.com

Resource Scan

Scan Details

Site Domain mbusa.com
Base Domain mbusa.com
Scan Status Ok
Last Scan2024-11-05T04:33:07+00:00
Next Scan 2024-12-05T04:33:07+00:00

Last Scan

Scanned2024-11-05T04:33:07+00:00
URL https://mbusa.com/robots.txt
Domain IPs 192.229.163.90
Response IP 192.229.163.90
Found Yes
Hash 0f1ef1851881479ade7ebbc81b4bd16900bfbe06c706c91659cdcb29b199c519
SimHash a2180f2a6912

Groups

gsa-crawler

Rule Path
Disallow

*

Rule Path
Disallow /*compare?year1=
Disallow /*ProxyServlet?
Disallow /*?modelCode=
Disallow /save/
Disallow /brand/
Disallow /byo/
Disallow /MBServlet/
Disallow /tracking/
Disallow /data/
Disallow /pre-owned/
Disallow /main/
Disallow /hash/
Disallow /media/
Disallow /microsite/
Disallow /campaigns/
Disallow /interests/
Disallow /*groupID
Disallow /*WT.srch
Disallow /*WT.mc_id
Disallow /*utm_medium
Disallow /*utm_source
Disallow /*utm_term
Disallow /*utm_campaign
Disallow /*utm_content
Disallow /*optionId
Disallow /*print
Disallow /modal/
Disallow /*save?
Disallow /social/facebook/vehicles_tab
Disallow /json/*
Disallow /prototype/*
Disallow /portfolio/payment_estimators/print
Disallow /styleguides/*
Disallow /*/ddt/*
Disallow /cpo/inventory/*/reserve-*
Disallow /errors/ie11-intercept
Disallow /en/shopping-bag
Disallow /en/checkout

Other Records

Field Value
sitemap https://www.mbusa.com/index-sitemap.xml
sitemap https://www.mbusa.com/css-sitemap/en_US