bent.news
robots.txt
Robots Exclusion Standard data for bent.news
Resource Scan
Scan Details
| Site Domain | bent.news |
| Base Domain | bent.news |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-30T12:17:18+00:00 |
| Next Scan | 2024-11-28T12:17:18+00:00 |
Last Successful Scan
| Scanned | 2023-01-15T18:59:52+00:00 |
| URL | https://bent.news/robots.txt |
| Domain IPs | 137.184.99.2 |
| Response IP | 137.184.99.2 |
| Found | Yes |
| Hash | 1599160aadc4db356376c1efc4589b856f649ca1443fcaee5aa3bbed2bbdf718 |
| SimHash | 610088000bb3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bent.news/sitemap_index.xml |