equipmenttraderonline.com
robots.txt
Robots Exclusion Standard data for equipmenttraderonline.com
Resource Scan
Scan Details
Site Domain | equipmenttraderonline.com |
Base Domain | equipmenttraderonline.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-05T08:52:48+00:00 |
Next Scan | 2024-06-12T08:52:48+00:00 |
Last Successful Scan
Scanned | 2022-11-27T13:06:27+00:00 |
URL | https://equipmenttraderonline.com/robots.txt |
Redirect | https://www.equipmenttrader.com/robots.txt |
Redirect Domain | www.equipmenttrader.com |
Redirect Base | equipmenttrader.com |
Response IP | 104.18.14.91, 104.18.15.91 |
Found | Yes |
Hash | f0df92f8477199ea75d5ebe0f613e591cb25c374cef7dbef12a943bb39263211 |
SimHash | fa79604ddd16 |
Groups
*
Rule | Path |
---|---|
Disallow | /*listing/http |
Disallow | /find/listing/print/ |
Disallow | /find/listing/photos/print/ |
Disallow | /find/listing-emaillisting/ |
Disallow | /find/website/ |
Disallow | /find/website/listing/ |
Disallow | */myt/ |
Disallow | */brochure |
Disallow | /find/dealers/print |
Disallow | /dealers/print |
Disallow | /advertiser-agreement |
Disallow | /community-guidelines |
Disallow | /mediainfo.html |
Disallow | /security |
Disallow | /*datalink$ |
Disallow | /*MOBILE%3Dfalse |
Disallow | /*vrsn%3Drss* |
Disallow | /*vrsn%3Diframe* |
Disallow | /*RENT-TO-OWN* |
Disallow | /*a-Href* |
Disallow | */email/* |
Disallow | /price%3D |
Disallow | /condition%3D |
Disallow | /seller_type%3D |
Other Records
Field | Value |
---|---|
sitemap | https://www.equipmenttrader.com/sitemaps/equip-sitemap.xml |