botleg.com
robots.txt
Robots Exclusion Standard data for botleg.com
Resource Scan
Scan Details
| Site Domain | botleg.com |
| Base Domain | botleg.com |
| Scan Status | Ok |
| Last Scan | 2025-11-18T04:50:59+00:00 |
| Next Scan | 2025-12-18T04:50:59+00:00 |
Last Scan
| Scanned | 2025-11-18T04:50:59+00:00 |
| URL | https://botleg.com/robots.txt |
| Domain IPs | 104.21.59.14, 172.67.210.244, 2606:4700:3033::6815:3b0e, 2606:4700:3037::ac43:d2f4 |
| Response IP | 172.67.210.244 |
| Found | Yes |
| Hash | c49a62b58031a3a6c79c342235d1f700386ef85ea0e6bf3de7a4fc510992a92e |
| SimHash | c6750953c5d7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
Warnings
- 24 invalid lines.
- `<img src="https` is not a known field.
- `<script src="https` is not a known field.
- `content-signal` is not a known field.
Comments