breakingnewsusatoday.com
robots.txt
Robots Exclusion Standard data for breakingnewsusatoday.com
Resource Scan
Scan Details
Site Domain | breakingnewsusatoday.com |
Base Domain | breakingnewsusatoday.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-03-02T09:28:36+00:00 |
Next Scan | 2024-05-31T09:28:36+00:00 |
Last Successful Scan
Scanned | 2022-09-18T13:08:39+00:00 |
URL | http://breakingnewsusatoday.com/robots.txt |
Response IP | 99.83.154.118 |
Found | Yes |
Hash | 81150fed4cd6b900092954012f0a8181687ab60105f4ff82e33b6f19277123f6 |
SimHash | 64a75840449a |
Groups
Warnings
- `request-rate` is not a known field.