rvtrader.com
robots.txt
Robots Exclusion Standard data for rvtrader.com
Resource Scan
Scan Details
| Site Domain | rvtrader.com |
| Base Domain | rvtrader.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-11T08:08:07+00:00 |
| Next Scan | 2024-11-18T08:08:07+00:00 |
Last Successful Scan
| Scanned | 2024-08-03T22:36:59+00:00 |
| URL | https://rvtrader.com/robots.txt |
| Redirect | https://www.rvtrader.com/robots.txt |
| Redirect Domain | www.rvtrader.com |
| Redirect Base | rvtrader.com |
| Domain IPs | 34.193.11.146, 35.170.42.192, 44.205.37.65 |
| Redirect IPs | 2600:9000:2175:1600:b:3dd1:840:93a1, 2600:9000:2175:200:b:3dd1:840:93a1, 2600:9000:2175:4600:b:3dd1:840:93a1, 2600:9000:2175:5800:b:3dd1:840:93a1, 2600:9000:2175:5a00:b:3dd1:840:93a1, 2600:9000:2175:ae00:b:3dd1:840:93a1, 2600:9000:2175:ca00:b:3dd1:840:93a1, 2600:9000:2175:fc00:b:3dd1:840:93a1, 65.9.112.17, 65.9.112.56, 65.9.112.74, 65.9.112.94 |
| Response IP | 18.165.171.5 |
| Found | Yes |
| Hash | e13cb1da58e77b4f7f35c0c66ef8c72dac85027efd1d166c7f1eeaa719c9eb7a |
| SimHash | 1a7c6c4d5e06 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*listing/http |
| Disallow | /find/listing/print/ |
| Disallow | /find/listing/photos/print/ |
| Disallow | /find/listing-emaillisting/ |
| Disallow | /find/website/ |
| Disallow | /find/website/listing/ |
| Disallow | */myt/ |
| Disallow | /find/dealers/print |
| Disallow | /rv-dealers/print |
| Disallow | /advertiser-agreement |
| Disallow | /community-guidelines |
| Disallow | /mediainfo.html |
| Disallow | /security |
| Disallow | /dealer-search-results/ |
| Disallow | /*datalink$ |
| Disallow | /*MOBILE%3Dfalse |
| Disallow | /*vrsn%3Drss* |
| Disallow | /*lat%3D* |
| Disallow | /*long%3D* |
| Disallow | /*affilid%3D* |
| Disallow | /*media%3D* |
| Disallow | /*vrsn%3Diframe* |
| Disallow | */email/* |
| Disallow | /*RENT-TO-OWN* |
| Disallow | /*a-Href* |
| Disallow | /*Buy-Here |
| Disallow | /Retro*440465 |
| Disallow | */Gettiledata/* |
| Disallow | /gettiledata/topic/ |
| Disallow | *adFeatureId%3D |
| Disallow | *category%3DParts |
| Disallow | /listing/loancalculator/* |
| Disallow | *type%3DanySort |
| Disallow | /*sort%3Dfeatured |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rvtrader.com/sitemaps/rv-sitemap-root.xml |