syogyo.jp
robots.txt
Robots Exclusion Standard data for syogyo.jp
Resource Scan
Scan Details
Site Domain | syogyo.jp |
Base Domain | syogyo.jp |
Scan Status | Ok |
Last Scan | 2024-11-16T03:07:38+00:00 |
Next Scan | 2024-11-23T03:07:38+00:00 |
Last Scan
Scanned | 2024-11-16T03:07:38+00:00 |
URL | https://syogyo.jp/robots.txt |
Domain IPs | 13.115.176.58, 52.68.27.132 |
Response IP | 13.115.176.58 |
Found | Yes |
Hash | aa0b9d6e3bbe54d7f7db1f35398596a528c4edaaec8c16d56aff46fe31e791c1 |
SimHash | 611ed190c232 |
Groups
*
Rule | Path |
---|---|
Allow | * |
Disallow | /admin/ |
bingbot
Rule | Path |
---|---|
Allow | * |
Disallow | /search |
Disallow | /search/ |
Disallow | /admin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
chatgpt-user
Rule | Path |
---|---|
Allow | * |
Disallow | /search |
Disallow | /search/ |
Disallow | /admin/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |