bbs.co.jp
robots.txt
Robots Exclusion Standard data for bbs.co.jp
Resource Scan
Scan Details
| Site Domain | bbs.co.jp |
| Base Domain | bbs.co.jp |
| Scan Status | Ok |
| Last Scan | 2024-06-26T01:28:24+00:00 |
| Next Scan | 2024-07-26T01:28:24+00:00 |
Last Scan
| Scanned | 2024-06-26T01:28:24+00:00 |
| URL | https://bbs.co.jp/robots.txt |
| Redirect | https://www.bbs.co.jp/robots.txt |
| Redirect Domain | www.bbs.co.jp |
| Redirect Base | bbs.co.jp |
| Domain IPs | 203.216.204.197 |
| Redirect IPs | 108.156.133.107, 108.156.133.24, 108.156.133.35, 108.156.133.43, 2600:9000:2755:1e00:1:934d:ee40:93a1, 2600:9000:2755:2200:1:934d:ee40:93a1, 2600:9000:2755:3c00:1:934d:ee40:93a1, 2600:9000:2755:4c00:1:934d:ee40:93a1, 2600:9000:2755:5000:1:934d:ee40:93a1, 2600:9000:2755:9200:1:934d:ee40:93a1, 2600:9000:2755:9a00:1:934d:ee40:93a1, 2600:9000:2755:9e00:1:934d:ee40:93a1 |
| Response IP | 108.156.133.35 |
| Found | Yes |
| Hash | 6476fcbaf1d37bcfd15a8e85025653a72c233d782927221c6d081f01b97bfa2e |
| SimHash | 1158d407c535 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /.shared/ |
| Disallow | /.service/ |
| Disallow | /.preview/ |
| Disallow | /.not-found/ |
wisewebcrawler
| Rule | Path |
|---|---|
| Disallow | /case/?page=2 |
| Disallow | /case/?page=3 |
| Disallow | /case/?page=4 |
| Disallow | /case/?page=5 |
| Disallow | /case/bpo/?page=2 |
| Disallow | /case/bpo/?page=3 |
| Disallow | /column/?page=2 |
| Disallow | /column/?page=3 |
| Disallow | /column/?page=4 |
| Disallow | /column/?page=5 |
| Disallow | /column/?page=6 |
| Disallow | /column/?page=7 |
| Disallow | /column/?page=8 |
| Disallow | /column/?page=9 |
| Disallow | /column/?page=10 |
| Disallow | /*.jpg$ |
| Disallow | /*.png$ |
| Disallow | /*.gif$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bbs.co.jp/sitemap.xml |