gazeta.ua
robots.txt
Robots Exclusion Standard data for gazeta.ua
Resource Scan
Scan Details
| Site Domain | gazeta.ua |
| Base Domain | gazeta.ua |
| Scan Status | Ok |
| Last Scan | 2024-05-01T20:27:23+00:00 |
| Next Scan | 2024-05-08T20:27:23+00:00 |
Last Scan
| Scanned | 2024-05-01T20:27:23+00:00 |
| URL | https://gazeta.ua/robots.txt |
| Domain IPs | 104.18.20.28, 104.18.21.28, 2606:4700::6812:141c, 2606:4700::6812:151c |
| Response IP | 104.18.21.28 |
| Found | Yes |
| Hash | 83cfe42b26f0e0d60b4d34e370c6b3ddd94b23719c6fb7e6db1f3614927f2bf8 |
| SimHash | 7b0efd404680 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax.php |
| Disallow | /cache/ |
| Disallow | /captcha/ |
| Disallow | /cgi-bin/ |
| Disallow | /css/ |
| Disallow | /design/ |
| Disallow | /dphoto/ |
| Disallow | /errors/ |
| Disallow | /export/csv/ |
| Disallow | /export/excel/ |
| Disallow | /export/mailru_informer.html |
| Disallow | /forum/ |
| Disallow | /images/ |
| Disallow | /images2/ |
| Disallow | /img/ |
| Disallow | /jsz/ |
| Disallow | /lib/ |
| Disallow | /logs/ |
| Disallow | /mantis/ |
| Disallow | /media/ |
| Disallow | /public_informers/ |
| Disallow | /scripts/ |
| Disallow | /style/ |
| Disallow | /tmp/ |
| Disallow | /user/login/ |
| Disallow | /ru/user/login/ |
| Disallow | /registration/ |
| Disallow | /ru/registration/ |
| Disallow | /user/remind/ |
| Disallow | /ru/user/remind/ |
| Disallow | /blogsearch/ |
| Disallow | /ru/blogsearch/ |
| Disallow | /search/ |
| Disallow | /ru/search/ |
| Disallow | /tag/ |
| Disallow | /ru/tag/ |
| Disallow | /index/archive/ |
| Disallow | /ru/index/archive/ |
| Disallow | /pda/ |
| Disallow | /ru/pda/ |
| Disallow | /concurs/ |
| Disallow | /ru/concurs/ |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax.php |
| Disallow | /cache/ |
| Disallow | /captcha/ |
| Disallow | /cgi-bin/ |
| Disallow | /css/ |
| Disallow | /design/ |
| Disallow | /dphoto/ |
| Disallow | /errors/ |
| Disallow | /export/csv/ |
| Disallow | /export/excel/ |
| Disallow | /export/mailru_informer.html |
| Disallow | /forum/ |
| Disallow | /images/ |
| Disallow | /images2/ |
| Disallow | /img/ |
| Disallow | /jsz/ |
| Disallow | /lib/ |
| Disallow | /logs/ |
| Disallow | /mantis/ |
| Disallow | /media/ |
| Disallow | /public_informers/ |
| Disallow | /scripts/ |
| Disallow | /style/ |
| Disallow | /tmp/ |
| Disallow | /user/login/ |
| Disallow | /ru/user/login/ |
| Disallow | /registration/ |
| Disallow | /ru/registration/ |
| Disallow | /user/remind/ |
| Disallow | /ru/user/remind/ |
| Disallow | /blogsearch/ |
| Disallow | /ru/blogsearch/ |
| Disallow | /search/ |
| Disallow | /ru/search/ |
| Disallow | /tag/ |
| Disallow | /ru/tag/ |
| Disallow | /index/archive/ |
| Disallow | /ru/index/archive/ |
| Disallow | /pda/ |
| Disallow | /ru/pda/ |
| Disallow | /concurs/ |
| Disallow | /ru/concurs/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gazeta.ua/sitemaps/sitemapindex.xml |