lightnovelcave.com
robots.txt

Robots Exclusion Standard data for lightnovelcave.com

Resource Scan

Scan Details

Site Domain lightnovelcave.com
Base Domain lightnovelcave.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-22T05:32:56+00:00
Next Scan 2024-06-20T05:32:56+00:00

Last Successful Scan

Scanned2023-08-25T16:23:50+00:00
URL https://lightnovelcave.com/robots.txt
Redirect https://www.lightnovelcave.com/robots.txt
Redirect Domain www.lightnovelcave.com
Redirect Base lightnovelcave.com
Domain IPs 104.21.92.65, 172.67.187.159, 2606:4700:3031::ac43:bb9f, 2606:4700:3035::6815:5c41
Redirect IPs 104.21.92.65, 172.67.187.159, 2606:4700:3031::ac43:bb9f, 2606:4700:3035::6815:5c41
Response IP 172.67.187.159
Found Yes
Hash 4b30d1f4cc26ba7aff4f22061da99faa50f354f2ad3722191bd395f0d831c281
SimHash 4150c1524731

Groups

*

Rule Path
Allow /