dealerrater.com
robots.txt

Robots Exclusion Standard data for dealerrater.com

Resource Scan

Scan Details

Site Domain dealerrater.com
Base Domain dealerrater.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-09T13:19:11+00:00
Next Scan 2024-08-07T13:19:11+00:00

Last Successful Scan

Scanned2023-01-08T02:36:17+00:00
URL https://dealerrater.com/robots.txt
Redirect https://www.dealerrater.com/robots.txt
Redirect Domain www.dealerrater.com
Redirect Base dealerrater.com
Domain IPs 13.35.8.13, 13.35.8.67, 13.35.8.73, 13.35.8.98
Redirect IPs 13.35.8.13, 13.35.8.67, 13.35.8.73, 13.35.8.98
Response IP 13.35.8.13
Found Yes
Hash be4e653e8d3541203ff6b704d4d92cddd835ec8bafc122e94cba7a0ab74071cd
SimHash 5259c966c373

Groups

*

Rule Path
Disallow /dealer/print.aspx
Disallow /dealer/report.aspx
Disallow /dealer/respond.aspx
Disallow /dealer/filtered-reviews.aspx
Disallow /redirect.aspx
Disallow /login/
Disallow /login*
Disallow /register/*
Disallow /consumer/forgotPassword/
Disallow /ajax/
Disallow /dealer/for-sale.aspx
Disallow /classifieds/leads-contact.aspx
Disallow /os/
Disallow /error
Disallow /error.aspx
Disallow /consumer/writereviews/*
Disallow /directory/z/*
Disallow /classifieds/search/z/*
Disallow /sales2/*
Disallow *_ni%3D2*

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dealerrater.com/sitemap.xml