chrono24.de
robots.txt
Robots Exclusion Standard data for chrono24.de
Resource Scan
Scan Details
| Site Domain | chrono24.de |
| Base Domain | chrono24.de |
| Scan Status | Ok |
| Last Scan | 2024-09-17T19:08:05+00:00 |
| Next Scan | 2024-10-17T19:08:05+00:00 |
Last Scan
| Scanned | 2024-09-17T19:08:05+00:00 |
| URL | https://chrono24.de/robots.txt |
| Redirect | https://www.chrono24.de/robots.txt |
| Redirect Domain | www.chrono24.de |
| Redirect Base | chrono24.de |
| Domain IPs | 104.17.217.13, 104.17.218.13 |
| Redirect IPs | 104.17.217.13, 104.17.218.13 |
| Response IP | 104.17.218.13 |
| Found | Yes |
| Hash | 8e075a6a49a33c2cabfb33c60a037437c09150dc9de223364034dd5b732a25cc |
| SimHash | 520b1be997c0 |
Groups
searchmetricsbot
| Rule | Path |
|---|---|
| Disallow | /lib/ads/* |
| Disallow | /lib/generated/js/* |
| Disallow | */others/ajax_picturemover.htm* |
| Disallow | */others/popup_* |
| Disallow | */others/iframe_* |
| Disallow | */others/banner_link.htm* |
| Disallow | */others/buynow_link.htm* |
| Disallow | */others/clicktrack.htm* |
| Disallow | */others/adIframe* |
| Disallow | */search/similar-watches.htm* |
| Disallow | */search/modelrating.htm* |
| Disallow | */others/quickreply.htm* |
| Disallow | */user/activate.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
petalbot
| Rule | Path |
|---|---|
| Disallow | */dealer/checkout-rating.htm* |
| Disallow | /lib/ads/* |
| Disallow | /lib/generated/js/* |
| Disallow | */others/ajax_picturemover.htm* |
| Disallow | */others/popup_* |
| Disallow | */others/iframe_* |
| Disallow | */others/banner_link.htm* |
| Disallow | */others/buynow_link.htm* |
| Disallow | */others/clicktrack.htm* |
| Disallow | */others/adIframe* |
| Disallow | */search/similar-watches.htm* |
| Disallow | */search/modelrating.htm* |
| Disallow | */others/quickreply.htm* |
| Disallow | */user/activate.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /lib/ads/* |
| Disallow | /lib/generated/js/* |
| Disallow | */others/ajax_picturemover.htm* |
| Disallow | */others/popup_* |
| Disallow | */others/iframe_* |
| Disallow | */others/banner_link.htm* |
| Disallow | */others/buynow_link.htm* |
| Disallow | */others/clicktrack.htm* |
| Disallow | */others/adIframe* |
| Disallow | */url/military-watches* |
| Disallow | *url%2*military-watches* |
| Disallow | */search/suggest.htm* |
| Disallow | */search/similar-watches.htm* |
| Disallow | */search/detail.htm*%26notes* |
| Disallow | */search/detail.htm*%26originalNotes* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.1 |
*
| Rule | Path |
|---|---|
| Disallow | /lib/ads/* |
| Disallow | /lib/generated/js/* |
| Disallow | */others/ajax_picturemover.htm* |
| Disallow | */others/popup_* |
| Disallow | */others/iframe_* |
| Disallow | */others/banner_link.htm* |
| Disallow | */others/buynow_link.htm* |
| Disallow | */others/clicktrack.htm* |
| Disallow | */others/adIframe* |
| Disallow | */search/similar-watches.htm* |
| Disallow | */search/modelrating.htm* |
| Disallow | */others/quickreply.htm* |
| Disallow | */user/activate.htm* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.1 |
Comments