equipmenttrader.com
robots.txt
Robots Exclusion Standard data for equipmenttrader.com
Resource Scan
Scan Details
| Site Domain | equipmenttrader.com |
| Base Domain | equipmenttrader.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-20T16:08:01+00:00 |
| Next Scan | 2024-09-27T16:08:01+00:00 |
Last Successful Scan
| Scanned | 2024-08-01T12:43:55+00:00 |
| URL | https://equipmenttrader.com/robots.txt |
| Redirect | https://www.equipmenttrader.com/robots.txt |
| Redirect Domain | www.equipmenttrader.com |
| Redirect Base | equipmenttrader.com |
| Domain IPs | 18.232.28.97, 34.228.46.253, 44.209.73.109 |
| Redirect IPs | 2600:9000:21f8:0:d:2ff6:580:93a1, 2600:9000:21f8:1800:d:2ff6:580:93a1, 2600:9000:21f8:2e00:d:2ff6:580:93a1, 2600:9000:21f8:4600:d:2ff6:580:93a1, 2600:9000:21f8:a800:d:2ff6:580:93a1, 2600:9000:21f8:bc00:d:2ff6:580:93a1, 2600:9000:21f8:d400:d:2ff6:580:93a1, 2600:9000:21f8:e400:d:2ff6:580:93a1, 52.222.144.123, 52.222.144.34, 52.222.144.66, 52.222.144.99 |
| Response IP | 3.160.246.114 |
| Found | Yes |
| Hash | 568d754f1ae0c191d1b4b8ec10ef2fa4a1f9cac244dc469b3416814d9e738a7a |
| SimHash | ba79784ddc06 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*listing/http |
| Disallow | /find/listing/print/ |
| Disallow | /find/listing/photos/print/ |
| Disallow | /find/listing-emaillisting/ |
| Disallow | /find/website/ |
| Disallow | /find/website/listing/ |
| Disallow | */myt/ |
| Disallow | */brochure |
| Disallow | /find/dealers/print |
| Disallow | /dealers/print |
| Disallow | /advertiser-agreement |
| Disallow | /community-guidelines |
| Disallow | /mediainfo.html |
| Disallow | /security |
| Disallow | /*datalink$ |
| Disallow | /*MOBILE%3Dfalse |
| Disallow | /*vrsn%3Drss* |
| Disallow | /*lat%3D* |
| Disallow | /*long%3D* |
| Disallow | /*affilid%3D* |
| Disallow | /*media%3D* |
| Disallow | /*vrsn%3Diframe* |
| Disallow | /*RENT-TO-OWN* |
| Disallow | /*a-Href* |
| Disallow | */email/* |
| Disallow | /price%3D |
| Disallow | /condition%3D |
| Disallow | /seller_type%3D |
| Disallow | /gettiledata/topic/ |
| Disallow | */Gettiledata/* |
| Disallow | /*sort%3Dfeatured |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.equipmenttrader.com/sitemaps/equip-sitemap.xml |