thedealersden.com
robots.txt
Robots Exclusion Standard data for thedealersden.com
Resource Scan
Scan Details
| Site Domain | thedealersden.com |
| Base Domain | thedealersden.com |
| Scan Status | Ok |
| Last Scan | 2025-09-07T10:50:40+00:00 |
| Next Scan | 2025-10-07T10:50:40+00:00 |
Last Scan
| Scanned | 2025-09-07T10:50:40+00:00 |
| URL | https://thedealersden.com/robots.txt |
| Domain IPs | 104.26.2.120, 104.26.3.120, 172.67.75.3, 2606:4700:20::681a:278, 2606:4700:20::681a:378, 2606:4700:20::ac43:4b03 |
| Response IP | 104.26.2.120 |
| Found | Yes |
| Hash | 1bd78b07bd267a4e21a5dc4aa0cdd3a93719ddcd75116c8e6cae0a1df9ab55e5 |
| SimHash | 290779b5c761 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cache/ |
| Disallow | /config/ |
| Disallow | /library/ |
| Disallow | /module/ |
| Disallow | /SQL/ |
| Disallow | /cron.php |
| Disallow | /install.php |
| Disallow | /error_log |
| Disallow | /*?SID= |
| Disallow | /admin/ |
| Disallow | /administration/ |
| Disallow | /install/ |
| Disallow | /rss/ |
| Disallow | /advert/ |
| Disallow | /play-video/ |
| Disallow | /app/async* |
| Disallow | /members-area/ |
| Disallow | /members/ |
| Disallow | /sign-in-modal/ |
| Disallow | /sign-up-modal/ |
| Disallow | /forgot-username/ |
| Disallow | /forgot-password/ |
| Disallow | /bid/ |
| Disallow | /buy/ |
| Disallow | /offer/ |
| Disallow | /cart/ |
| Disallow | /listings/cart/ |
| Disallow | /advanced-search/ |
| Disallow | /sell/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments