lagendanews.com
robots.txt
Robots Exclusion Standard data for lagendanews.com
Resource Scan
Scan Details
Site Domain | lagendanews.com |
Base Domain | lagendanews.com |
Scan Status | Ok |
Last Scan | 2024-09-27T12:07:57+00:00 |
Next Scan | 2024-10-04T12:07:57+00:00 |
Last Scan
Scanned | 2024-09-27T12:07:57+00:00 |
URL | https://lagendanews.com/robots.txt |
Domain IPs | 80.88.87.132 |
Response IP | 80.88.87.132 |
Found | Yes |
Hash | 729b584b6cd938ca4817927564ef9049dee5113db144de8ee4cf87673d6ad37c |
SimHash | c07ccca2c2fb |
Groups
*
Rule | Path |
---|---|
Disallow | /*.jpg |
Disallow | /*.JPG |
Disallow | /*.png |
Disallow | |
Disallow | |
Disallow | /*.mp3 |
Disallow | /*.MOV |
Disallow | /*.mov |
Disallow | /*.AVI |
Disallow | /*.avi |
Disallow | /*.csv |
Disallow | /*.data |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |