lightnovel.vn
robots.txt
Robots Exclusion Standard data for lightnovel.vn
Resource Scan
Scan Details
Site Domain | lightnovel.vn |
Base Domain | lightnovel.vn |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-26T03:05:15+00:00 |
Next Scan | 2024-07-03T03:05:15+00:00 |
Last Successful Scan
Scanned | 2024-04-21T23:47:29+00:00 |
URL | https://lightnovel.vn/robots.txt |
Domain IPs | 104.21.13.145, 172.67.200.154, 2606:4700:3033::ac43:c89a, 2606:4700:3034::6815:d91 |
Response IP | 172.67.200.154 |
Found | Yes |
Hash | 33320de05979bb3c53e2d9242359241cb2bc02e99c3ad769c1b2fefa84c6e7e6 |
SimHash | 92af65437062 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /doubleclick/ |
Disallow | /eyeblaster/ |
Disallow | /tim-kiem/ |
Disallow | /404/ |
*
Rule | Path |
---|---|
Allow | / |
Comments