lightminer.co
robots.txt

Robots Exclusion Standard data for lightminer.co

Resource Scan

Scan Details

Site Domain lightminer.co
Base Domain lightminer.co
Scan Status Ok
Last Scan2025-10-12T16:54:35+00:00
Next Scan 2025-11-11T16:54:35+00:00

Last Scan

Scanned2025-10-12T16:54:35+00:00
URL https://lightminer.co/robots.txt
Domain IPs 104.21.33.168, 172.67.165.9, 2606:4700:3032::ac43:a509, 2606:4700:3037::6815:21a8
Response IP 172.67.165.9
Found Yes
Hash 66407e0215b2c8c61cae9527a8f187a12580ecb9660883bf64a19d529c700436
SimHash 8800ece2c7f2

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow

Warnings

  • `host` is not a known field.