winemart.jp
robots.txt
Robots Exclusion Standard data for winemart.jp
Resource Scan
Scan Details
Site Domain | winemart.jp |
Base Domain | winemart.jp |
Scan Status | Ok |
Last Scan | 2024-09-09T06:43:40+00:00 |
Next Scan | 2024-10-09T06:43:40+00:00 |
Last Scan
Scanned | 2024-09-09T06:43:40+00:00 |
URL | https://winemart.jp/robots.txt |
Redirect | https://www.winemart.jp/robots.txt |
Redirect Domain | www.winemart.jp |
Redirect Base | winemart.jp |
Domain IPs | 18.177.186.86, 35.77.238.240 |
Redirect IPs | 13.225.4.112, 13.225.4.36, 13.225.4.55, 13.225.4.91 |
Response IP | 13.225.4.55 |
Found | Yes |
Hash | bfbbe667ec04726391dc547e10abd9476d6b7aca93dd47105693394cdc3104c4 |
SimHash | b3f5d32d95b3 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /hojin/hitachi/ |
Disallow | /shopdetail/000000015151/ |
Disallow | /shopdetail/000000015152/ |
Disallow | /shopdetail/000000015154/ |
Disallow | /shopdetail/000000015156/ |
Disallow | /shopdetail/000000015157/ |
Disallow | /smartphone/detail.html?id=000000015151%2F |
Disallow | /smartphone/detail.html?id=000000015152%2F |
Disallow | /smartphone/detail.html?id=000000015154%2F |
Disallow | /smartphone/detail.html?id=000000015156%2F |
Disallow | /smartphone/detail.html?id=000000015157%2F |
Disallow | /hojin/mizuho/ |
Disallow | /hojin/kanematsu/ |
Disallow | /html/page19.html |
Disallow | /shopdetail/000000015231/ |
Disallow | /shopdetail/000000015229/ |
Disallow | /shopdetail/000000015208/ |
Disallow | /smartphone/detail.html?id=000000015231%2F |
Disallow | /smartphone/detail.html?id=000000015229%2F |
Disallow | /smartphone/detail.html?id=000000015208%2F |
Warnings
- 4 invalid lines.