asean.thenewslens.com
robots.txt
Robots Exclusion Standard data for asean.thenewslens.com
Resource Scan
Scan Details
Site Domain | asean.thenewslens.com |
Base Domain | thenewslens.com |
Scan Status | Ok |
Last Scan | 2024-05-25T10:27:29+00:00 |
Next Scan | 2024-06-24T10:27:29+00:00 |
Last Scan
Scanned | 2024-05-25T10:27:29+00:00 |
URL | https://asean.thenewslens.com/robots.txt |
Redirect | https://www.thenewslens.com/robots.txt |
Redirect Domain | www.thenewslens.com |
Redirect Base | thenewslens.com |
Domain IPs | 104.22.52.141, 104.22.53.141, 172.67.6.137, 2606:4700:10::6816:348d, 2606:4700:10::6816:358d, 2606:4700:10::ac43:689 |
Redirect IPs | 104.22.52.141, 104.22.53.141, 172.67.6.137, 2606:4700:10::6816:348d, 2606:4700:10::6816:358d, 2606:4700:10::ac43:689 |
Response IP | 104.22.53.141 |
Found | Yes |
Hash | bb01208d99f8a4ce22ba80d4103bfbe5a9f844b1017650e41bf84dbf2897b216 |
SimHash | 4210d960eb33 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /search |