list-ip.org
robots.txt
Robots Exclusion Standard data for list-ip.org
Resource Scan
Scan Details
| Site Domain | list-ip.org |
| Base Domain | list-ip.org |
| Scan Status | Ok |
| Last Scan | 2025-12-01T03:43:31+00:00 |
| Next Scan | 2025-12-31T03:43:31+00:00 |
Last Scan
| Scanned | 2025-12-01T03:43:31+00:00 |
| URL | https://list-ip.org/robots.txt |
| Redirect | https://www.list-ip.org/robots.txt |
| Redirect Domain | www.list-ip.org |
| Redirect Base | list-ip.org |
| Domain IPs | 104.21.24.119, 172.67.218.130 |
| Redirect IPs | 104.21.24.119, 172.67.218.130 |
| Response IP | 172.67.218.130 |
| Found | Yes |
| Hash | 53c105c2184c13094a506d631a354d13705d12062d8caa6048f4b1a20d417a2a |
| SimHash | 00695ac34f11 |
Groups
ahrefsbot
slurp
aport
baiduspider
teoma
scooter
ia_archiver
ia_archiver-web.archive.org
lycos
webalta
mj12bot
amazonbot
grapeshot
proximic
semrushbot
semrushbot-sa
| Rule | Path |
|---|---|
| Disallow | / |
yandex
mail.ru
| Rule | Path |
|---|---|
| Disallow | /kcap.php |
| Disallow | /search.php |
| Disallow | /edit.php |
| Disallow | /go.php |
| Disallow | /bot.php |
| Disallow | /js/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
*
| Rule | Path |
|---|---|
| Disallow | /kcap.php |
| Disallow | /edit.php |
| Disallow | /go.php |
| Disallow | /bot.php |
| Disallow | /js/ |
| Disallow | /stat/ |
Warnings
- `host` is not a known field.