jobs.ua
robots.txt
Robots Exclusion Standard data for jobs.ua
Resource Scan
Scan Details
| Site Domain | jobs.ua |
| Base Domain | jobs.ua |
| Scan Status | Ok |
| Last Scan | 2024-10-03T19:32:15+00:00 |
| Next Scan | 2024-10-10T19:32:15+00:00 |
Last Scan
| Scanned | 2024-10-03T19:32:15+00:00 |
| URL | https://jobs.ua/robots.txt |
| Domain IPs | 178.20.158.124 |
| Response IP | 178.20.158.124 |
| Found | Yes |
| Hash | e7b6ed68ed54f934879589a9829032c3467976ffacef33bf6d8bebba432494d3 |
| SimHash | 404193472339 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /dev/css/*.css |
| Allow | /dev/fonts/*.ttf |
| Allow | /dev/fonts/*.woff |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
| Disallow | /register |
| Disallow | /login |
| Disallow | /active_account_success |
| Disallow | /restore_password |
| Disallow | |
| Disallow | /*.doc$ |
| Disallow | /*?return_url=* |
| Disallow | /?gclid= |
| Disallow | /?utm_source= |
| Disallow | /?yclid= |
| Disallow | /*_openstat* |
| Disallow | /dev |
| Disallow | /crb |
| Disallow | /crb/list |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /dev/css/*.css |
| Allow | /dev/fonts/*.ttf |
| Allow | /dev/fonts/*.woff |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
| Disallow | /register |
| Disallow | /login |
| Disallow | /active_account_success |
| Disallow | /restore_password |
| Disallow | |
| Disallow | /*.doc$ |
| Disallow | /*?return_url=* |
| Disallow | /?gclid= |
| Disallow | /?utm_source= |
| Disallow | /?yclid= |
| Disallow | /*_openstat* |
| Disallow | /dev |
| Disallow | /crb |
| Disallow | /crb/list |
googlebot-image
| Rule | Path |
|---|---|
| Allow | *images* |
| Allow | *jpg* |
| Allow | *jpeg* |
| Allow | *png* |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
yandex
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /dev/css/*.css |
| Allow | /dev/fonts/*.ttf |
| Allow | /dev/fonts/*.woff |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
| Disallow | /register |
| Disallow | /login |
| Disallow | /active_account_success |
| Disallow | /restore_password |
| Disallow | |
| Disallow | /*.doc$ |
| Disallow | /*?return_url=* |
| Disallow | /?gclid= |
| Disallow | /?utm_source= |
| Disallow | /?yclid= |
| Disallow | /*_openstat* |
| Disallow | /dev |
| Disallow | /crb |
| Disallow | /crb/list |
yandeximages
| Rule | Path |
|---|---|
| Allow | *images* |
| Allow | *jpg* |
| Allow | *jpeg* |
| Allow | *png* |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
mail.ru
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /dev/css/*.css |
| Allow | /dev/fonts/*.ttf |
| Allow | /dev/fonts/*.woff |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
| Disallow | /register |
| Disallow | /login |
| Disallow | /active_account_success |
| Disallow | /restore_password |
| Disallow | |
| Disallow | /*.doc$ |
| Disallow | /*?return_url=* |
| Disallow | /?gclid= |
| Disallow | /?utm_source= |
| Disallow | /?yclid= |
| Disallow | /*_openstat* |
| Disallow | /dev |
| Disallow | /crb |
| Disallow | /crb/list |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /dev/css/*.css |
| Allow | /dev/fonts/*.ttf |
| Allow | /dev/fonts/*.woff |
| Allow | /dev/images/cats_list/*.ico |
| Allow | /dev/images/design/*.svg |
| Allow | /dev/images/design/*.png |
| Disallow | /register |
| Disallow | /login |
| Disallow | /active_account_success |
| Disallow | /restore_password |
| Disallow | |
| Disallow | /*.doc$ |
| Disallow | /*?return_url=* |
| Disallow | /?gclid= |
| Disallow | /?utm_source= |
| Disallow | /?yclid= |
| Disallow | /*_openstat* |
| Disallow | /dev |
| Disallow | /crb |
| Disallow | /crb/list |
Other Records
| Field | Value |
|---|---|
| sitemap | https://jobs.ua/sitemap.xml |
Warnings
- `host` is not a known field.