litmir.me
robots.txt
Robots Exclusion Standard data for litmir.me
Resource Scan
Scan Details
| Site Domain | litmir.me |
| Base Domain | litmir.me |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-18T10:24:45+00:00 |
| Next Scan | 2024-11-16T10:24:45+00:00 |
Last Successful Scan
| Scanned | 2023-01-23T13:58:49+00:00 |
| URL | https://litmir.me/robots.txt |
| Redirect | https://www.litmir.me/robots.txt |
| Redirect Domain | www.litmir.me |
| Redirect Base | litmir.me |
| Domain IPs | 104.22.2.96, 104.22.3.96, 172.67.24.78, 2606:4700:10::6816:260, 2606:4700:10::6816:360, 2606:4700:10::ac43:184e |
| Redirect IPs | 104.22.2.96, 104.22.3.96, 172.67.24.78, 2606:4700:10::6816:260, 2606:4700:10::6816:360, 2606:4700:10::ac43:184e |
| Response IP | 172.67.24.78 |
| Found | Yes |
| Hash | 2dc2190743e7962d9e1ba75530b53ec4da1d0f130886315581874729ec101354 |
| SimHash | 0d043f628612 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /main_page |
| Allow | /bd |
| Allow | /br |
| Allow | /all_genre |
| Allow | /bs/?g= |
| Allow | /bs?g= |
| Allow | /series |
| Allow | /books_in_series |
| Allow | /as |
| Allow | /a |
| Allow | /BlogLoad |
| Allow | /sitemap |
| Allow | /data |
| Allow | /img |
| Allow | /font |
| Allow | /static |
| Allow | /Static |
| Allow | /favicon.ico |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.litmir.me/sitemap.xml |
Warnings
- `host` is not a known field.