topreading.ru
robots.txt
Robots Exclusion Standard data for topreading.ru
Resource Scan
Scan Details
| Site Domain | topreading.ru |
| Base Domain | topreading.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-20T02:16:41+00:00 |
| Next Scan | 2024-11-18T02:16:41+00:00 |
Last Successful Scan
| Scanned | 2023-10-26T01:18:42+00:00 |
| URL | https://topreading.ru/robots.txt |
| Domain IPs | 185.92.149.92 |
| Response IP | 185.92.149.92 |
| Found | Yes |
| Hash | a425c9964a7cf90667f2a5b2d2a2495ff31c678f0c79ae434ce3ad4968e75e07 |
| SimHash | 6508dd42ed12 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://topreading.ru/sitemap_main.xml |
| sitemap | https://topreading.ru/sitemap-books-keys.xml |
| sitemap | https://topreading.ru/sitemap-authors-keys.xml |
| sitemap | https://topreading.ru/sitemap_pdfs.xml |
Warnings
- `host` is not a known field.