city.komae.tokyo.jp
robots.txt
Robots Exclusion Standard data for city.komae.tokyo.jp
Resource Scan
Scan Details
| Site Domain | city.komae.tokyo.jp |
| Base Domain | city.komae.tokyo.jp |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-12T07:12:39+00:00 |
| Next Scan | 2025-02-10T07:12:39+00:00 |
Last Successful Scan
| Scanned | 2024-03-25T06:29:43+00:00 |
| URL | https://www.city.komae.tokyo.jp/robots.txt |
| Domain IPs | 13.33.88.100, 13.33.88.26, 13.33.88.42, 13.33.88.58, 2600:9000:223b:1200:c:e2fb:a800:93a1, 2600:9000:223b:3000:c:e2fb:a800:93a1, 2600:9000:223b:4800:c:e2fb:a800:93a1, 2600:9000:223b:6200:c:e2fb:a800:93a1, 2600:9000:223b:8a00:c:e2fb:a800:93a1, 2600:9000:223b:aa00:c:e2fb:a800:93a1, 2600:9000:223b:cc00:c:e2fb:a800:93a1, 2600:9000:223b:e600:c:e2fb:a800:93a1 |
| Response IP | 13.33.88.100 |
| Found | Yes |
| Hash | 3931f6d8e94eef5499aaa76890e9bfe2eca9c8d03626eab833e45d6ac74fea94 |
| SimHash | 0550dd1de992 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | common/ |
| Disallow | contactform/ |
| Disallow | custom/ |
| Disallow | error/ |
| Disallow | getlogin/ |
| Disallow | handlers/ |
| Disallow | images/ |
| Disallow | search/ |
| Disallow | setup/ |
| Disallow | styles/ |
| Disallow | subscriptions/ |
| Disallow | _collections/ |
| Disallow | _queries/ |
| Disallow | _resources/ |
| Disallow | _key/ |
| Disallow | /apps/pai/ |
| Disallow | bosai/ |