bigrobot.news
robots.txt
Robots Exclusion Standard data for bigrobot.news
Resource Scan
Scan Details
| Site Domain | bigrobot.news |
| Base Domain | bigrobot.news |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-07-09T02:06:03+00:00 |
| Next Scan | 2025-10-07T02:06:03+00:00 |
Last Successful Scan
| Scanned | 2023-05-26T12:14:42+00:00 |
| URL | https://bigrobot.news/robots.txt |
| Domain IPs | 192.0.78.145, 192.0.78.205 |
| Response IP | 192.0.78.205 |
| Found | Yes |
| Hash | 071160091d08854a2d9f611b730eca340fd6dbe8a50b9182fe802ba773e74ee4 |
| SimHash | e120ce028bb3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bigrobot.news/sitemap.xml |
| sitemap | https://bigrobot.news/news-sitemap.xml |