equipmenttraderonline.com
robots.txt

Robots Exclusion Standard data for equipmenttraderonline.com

Resource Scan

Scan Details

Site Domain equipmenttraderonline.com
Base Domain equipmenttraderonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-26T20:05:29+00:00
Next Scan 2024-10-03T20:05:29+00:00

Last Successful Scan

Scanned2024-07-31T08:55:21+00:00
URL https://equipmenttraderonline.com/robots.txt
Redirect https://www.equipmenttrader.com/robots.txt
Redirect Domain www.equipmenttrader.com
Redirect Base equipmenttrader.com
Domain IPs 18.232.28.97, 34.228.46.253, 44.209.73.109
Redirect IPs 13.226.2.56, 13.226.2.83, 13.226.2.84, 13.226.2.9, 2600:9000:21f8:3400:d:2ff6:580:93a1, 2600:9000:21f8:4200:d:2ff6:580:93a1, 2600:9000:21f8:7e00:d:2ff6:580:93a1, 2600:9000:21f8:8400:d:2ff6:580:93a1, 2600:9000:21f8:8800:d:2ff6:580:93a1, 2600:9000:21f8:d600:d:2ff6:580:93a1, 2600:9000:21f8:f200:d:2ff6:580:93a1, 2600:9000:21f8:fa00:d:2ff6:580:93a1
Response IP 13.226.2.83
Found Yes
Hash 568d754f1ae0c191d1b4b8ec10ef2fa4a1f9cac244dc469b3416814d9e738a7a
SimHash ba79784ddc06

Groups

*

Rule Path
Disallow /*listing/http
Disallow /find/listing/print/
Disallow /find/listing/photos/print/
Disallow /find/listing-emaillisting/
Disallow /find/website/
Disallow /find/website/listing/
Disallow */myt/
Disallow */brochure
Disallow /find/dealers/print
Disallow /dealers/print
Disallow /advertiser-agreement
Disallow /community-guidelines
Disallow /mediainfo.html
Disallow /security
Disallow /*datalink$
Disallow /*MOBILE%3Dfalse
Disallow /*vrsn%3Drss*
Disallow /*lat%3D*
Disallow /*long%3D*
Disallow /*affilid%3D*
Disallow /*media%3D*
Disallow /*vrsn%3Diframe*
Disallow /*RENT-TO-OWN*
Disallow /*a-Href*
Disallow */email/*
Disallow /price%3D
Disallow /condition%3D
Disallow /seller_type%3D
Disallow /gettiledata/topic/
Disallow */Gettiledata/*
Disallow /*sort%3Dfeatured

chatalogica.com cgi script

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

slysearch

Rule Path
Disallow *

sna-0.0.1 mikeelliott@hotmail.com

Rule Path
Disallow /

textminer/5.3

Rule Path
Disallow *

vast_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.equipmenttrader.com/sitemaps/equip-sitemap.xml