booksonline.com.ua
robots.txt
Robots Exclusion Standard data for booksonline.com.ua
Resource Scan
Scan Details
| Site Domain | booksonline.com.ua |
| Base Domain | booksonline.com.ua |
| Scan Status | Ok |
| Last Scan | 2024-11-09T15:23:06+00:00 |
| Next Scan | 2024-11-16T15:23:06+00:00 |
Last Scan
| Scanned | 2024-11-09T15:23:06+00:00 |
| URL | https://booksonline.com.ua/robots.txt |
| Domain IPs | 104.21.84.26, 172.67.185.10, 2606:4700:3031::ac43:b90a, 2606:4700:3037::6815:541a |
| Response IP | 172.67.185.10 |
| Found | Yes |
| Hash | 496e8318569db2c7300fbb7ee64ff9d0f97ce231a42e51842825eb6fe83a0e4a |
| SimHash | 3311ef4027f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /new/ |
| Disallow | /register* |
| Disallow | /enter* |
| Disallow | /search* |
| Disallow | /forgot* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://booksonline.com.ua/sitemap-index-3-books.xml |
| sitemap | http://booksonline.com.ua/sitemap-index-3-com.xml |
| sitemap | http://booksonline.com.ua/sitemap-index-3-keys.xml |
| sitemap | http://booksonline.com.ua/sitemap-index-3-review.xml |
| sitemap | http://booksonline.com.ua/sitemaps/sitemap_3_authors.xml |
| sitemap | http://booksonline.com.ua/sitemaps/sitemap_3_genres.xml |
| sitemap | http://booksonline.com.ua/sitemaps/sitemap_3_audio_new.xml |
| sitemap | http://booksonline.com.ua/blog/sitemap.xml |
Warnings
- `host` is not a known field.