thepennews.in
robots.txt
Robots Exclusion Standard data for thepennews.in
Resource Scan
Scan Details
Site Domain | thepennews.in |
Base Domain | thepennews.in |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-24T12:50:40+00:00 |
Next Scan | 2024-09-23T12:50:40+00:00 |
Last Successful Scan
Scanned | 2024-07-26T12:50:11+00:00 |
URL | https://thepennews.in/robots.txt |
Domain IPs | 195.35.21.33 |
Response IP | 195.35.21.33 |
Found | Yes |
Hash | 44f1304dc20daa401287ce66622ce9dde824933816bff46e10d6f8037c24a172 |
SimHash | 69019c000bb2 |
Other Records
Field | Value |
---|---|
sitemap | https://thepennews.in/sitemap_index.xml |