chrono24.jp
robots.txt
Robots Exclusion Standard data for chrono24.jp
Resource Scan
Scan Details
Site Domain | chrono24.jp |
Base Domain | chrono24.jp |
Scan Status | Ok |
Last Scan | 2024-09-15T05:23:05+00:00 |
Next Scan | 2024-10-15T05:23:05+00:00 |
Last Scan
Scanned | 2024-09-15T05:23:05+00:00 |
URL | https://chrono24.jp/robots.txt |
Redirect | https://www.chrono24.jp/robots.txt |
Redirect Domain | www.chrono24.jp |
Redirect Base | chrono24.jp |
Domain IPs | 104.17.217.13, 104.17.218.13 |
Redirect IPs | 104.17.217.13, 104.17.218.13 |
Response IP | 104.17.218.13 |
Found | Yes |
Hash | 8e075a6a49a33c2cabfb33c60a037437c09150dc9de223364034dd5b732a25cc |
SimHash | 520b1be997c0 |
Groups
searchmetricsbot
Rule | Path |
---|---|
Disallow | /lib/ads/* |
Disallow | /lib/generated/js/* |
Disallow | */others/ajax_picturemover.htm* |
Disallow | */others/popup_* |
Disallow | */others/iframe_* |
Disallow | */others/banner_link.htm* |
Disallow | */others/buynow_link.htm* |
Disallow | */others/clicktrack.htm* |
Disallow | */others/adIframe* |
Disallow | */search/similar-watches.htm* |
Disallow | */search/modelrating.htm* |
Disallow | */others/quickreply.htm* |
Disallow | */user/activate.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 0.5 |
petalbot
Rule | Path |
---|---|
Disallow | */dealer/checkout-rating.htm* |
Disallow | /lib/ads/* |
Disallow | /lib/generated/js/* |
Disallow | */others/ajax_picturemover.htm* |
Disallow | */others/popup_* |
Disallow | */others/iframe_* |
Disallow | */others/banner_link.htm* |
Disallow | */others/buynow_link.htm* |
Disallow | */others/clicktrack.htm* |
Disallow | */others/adIframe* |
Disallow | */search/similar-watches.htm* |
Disallow | */search/modelrating.htm* |
Disallow | */others/quickreply.htm* |
Disallow | */user/activate.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 0.1 |
googlebot
Rule | Path |
---|---|
Disallow | /lib/ads/* |
Disallow | /lib/generated/js/* |
Disallow | */others/ajax_picturemover.htm* |
Disallow | */others/popup_* |
Disallow | */others/iframe_* |
Disallow | */others/banner_link.htm* |
Disallow | */others/buynow_link.htm* |
Disallow | */others/clicktrack.htm* |
Disallow | */others/adIframe* |
Disallow | */url/military-watches* |
Disallow | *url%2*military-watches* |
Disallow | */search/suggest.htm* |
Disallow | */search/similar-watches.htm* |
Disallow | */search/detail.htm*%26notes* |
Disallow | */search/detail.htm*%26originalNotes* |
Other Records
Field | Value |
---|---|
crawl-delay | 0.1 |
*
Rule | Path |
---|---|
Disallow | /lib/ads/* |
Disallow | /lib/generated/js/* |
Disallow | */others/ajax_picturemover.htm* |
Disallow | */others/popup_* |
Disallow | */others/iframe_* |
Disallow | */others/banner_link.htm* |
Disallow | */others/buynow_link.htm* |
Disallow | */others/clicktrack.htm* |
Disallow | */others/adIframe* |
Disallow | */search/similar-watches.htm* |
Disallow | */search/modelrating.htm* |
Disallow | */others/quickreply.htm* |
Disallow | */user/activate.htm* |
Other Records
Field | Value |
---|---|
crawl-delay | 0.1 |
Comments