jobfilter.ru
robots.txt
Robots Exclusion Standard data for jobfilter.ru
Resource Scan
Scan Details
| Site Domain | jobfilter.ru |
| Base Domain | jobfilter.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-14T04:59:51+00:00 |
| Next Scan | 2024-11-21T04:59:51+00:00 |
Last Scan
| Scanned | 2024-11-14T04:59:51+00:00 |
| URL | https://jobfilter.ru/robots.txt |
| Domain IPs | 5.8.79.66 |
| Response IP | 5.8.79.66 |
| Found | Yes |
| Hash | 6ee03039ced621f1eb0069c97abd3d059a34c428772a425cb99d53b93e391b24 |
| SimHash | 321a6e02ce23 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /catalog |
| Disallow | /api |
| Disallow | /*?* |
| Disallow | /users/sign_in |
| Disallow | /person/sign_up |
| Disallow | /company/sign_up |
| Disallow | /users |
| Disallow | /my-vacancies |
| Disallow | /remove_viewed_vacancy |
| Disallow | /my-searches |
| Disallow | /login |
| Disallow | /signout |
| Disallow | /my-subscriptions |
| Disallow | /msb |
| Disallow | /fast |
| Disallow | /v |
| Disallow | */v/* |
| Disallow | /vacancy |
| Disallow | */vacancy/* |
| Disallow | /vacancies |
| Disallow | */visit$ |
| Disallow | */go$ |
| Disallow | */jr$ |
| Disallow | */rb |
| Disallow | /rb |
| Disallow | */sort/* |
| Disallow | */period/* |
| Disallow | */employment/* |
| Disallow | */category/* |
| Disallow | */experience/* |
| Disallow | */vacformat/* |
| Disallow | */searchtype/* |
| Disallow | */searchwhere/* |
yandexadditionalbot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /*?* |
| Disallow | /users/sign_in |
| Disallow | /person/sign_up |
| Disallow | /company/sign_up |
| Disallow | /users |
| Disallow | /my-vacancies |
| Disallow | /remove_viewed_vacancy |
| Disallow | /my-searches |
| Disallow | /login |
| Disallow | /signout |
| Disallow | /my-subscriptions |
| Disallow | /msb |
| Disallow | /vacancy |
| Disallow | */vacancy/* |
| Disallow | /vacancies |
| Disallow | */visit$ |
| Disallow | */go$ |
| Disallow | */jr$ |
| Disallow | */rb |
| Disallow | /rb |
| Disallow | */sort/* |
| Disallow | */period/* |
| Disallow | */employment/* |
| Disallow | */category/* |
| Disallow | */experience/* |
| Disallow | */vacformat/* |
| Disallow | */searchtype/* |
| Disallow | */searchwhere/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://jobfilter.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.