cbre-propertysearch.jp
robots.txt
Robots Exclusion Standard data for cbre-propertysearch.jp
Resource Scan
Scan Details
| Site Domain | cbre-propertysearch.jp |
| Base Domain | cbre-propertysearch.jp |
| Scan Status | Ok |
| Last Scan | 2024-10-25T16:08:40+00:00 |
| Next Scan | 2024-11-24T16:08:40+00:00 |
Last Scan
| Scanned | 2024-10-25T16:08:40+00:00 |
| URL | https://cbre-propertysearch.jp/robots.txt |
| Redirect | https://www.cbre-propertysearch.jp:443/robots.txt |
| Redirect Domain | www.cbre-propertysearch.jp |
| Redirect Base | cbre-propertysearch.jp |
| Domain IPs | 13.33.88.112, 13.33.88.122, 13.33.88.7, 13.33.88.92 |
| Redirect IPs | 13.114.206.222, 35.74.87.146 |
| Response IP | 35.74.87.146 |
| Found | Yes |
| Hash | e64466c77f7909451a60d442c289876921a490fbb0a668bdd6f0e666d7f2527c |
| SimHash | 731ddc61ea90 |
Groups
mj12bot
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
blexbot
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
amazonbot
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /pdf/detail/ |
| Disallow | /pdf/list/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.cbre-propertysearch.jp/sitemap.xml.gz |