dyler.com
robots.txt
Robots Exclusion Standard data for dyler.com
Resource Scan
Scan Details
Site Domain | dyler.com |
Base Domain | dyler.com |
Scan Status | Ok |
Last Scan | 2024-05-22T17:34:42+00:00 |
Next Scan | 2024-06-21T17:34:42+00:00 |
Last Scan
Scanned | 2024-05-22T17:34:42+00:00 |
URL | https://dyler.com/robots.txt |
Domain IPs | 172.66.40.107, 172.66.43.149, 2606:4700:3108::ac42:286b, 2606:4700:3108::ac42:2b95 |
Response IP | 172.66.40.107 |
Found | Yes |
Hash | 6e6ed323383a12348d7f3b06586af104c6aa539ce99f43bec88fd9f255567eeb |
SimHash | 61493b40d1bb |
Groups
*
Rule | Path |
---|---|
Disallow | /cars/*/report_items/* |
Disallow | /auto/*/report_items/* |
Disallow | /autos/*/report_items/* |
Disallow | /coches/*/report_items/* |
Disallow | /recently-viewed |
Disallow | /subscribers/new.js |
Disallow | /users/* |
Disallow | /posts/search |
Disallow | /currencies/set_currency/* |
Disallow | /cars/*/app/* |
Disallow | /auto/*/app/* |
Disallow | /autos/*/app/* |
Disallow | /coches/*/app/* |
Disallow | /blog/*/app/* |