dreamjob.ru
robots.txt
Robots Exclusion Standard data for dreamjob.ru
Resource Scan
Scan Details
| Site Domain | dreamjob.ru |
| Base Domain | dreamjob.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-17T10:04:07+00:00 |
| Next Scan | 2024-10-17T10:04:07+00:00 |
Last Scan
| Scanned | 2024-09-17T10:04:07+00:00 |
| URL | https://dreamjob.ru/robots.txt |
| Domain IPs | 185.65.148.210 |
| Response IP | 185.65.148.210 |
| Found | Yes |
| Hash | fe844c64f2d7b2ba20c6d4f053a30bb7b923da628f607e4d9d051ffdd0f7eaef |
| SimHash | 5c794de87113 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /add |
| Disallow | /site |
| Disallow | /*login |
| Disallow | /head-hunter/get-widget |
| Disallow | */amp/employers/* |
| Disallow | */amp/salary/* |
| Disallow | */amp-salary/index* |
| Disallow | */amp/employer* |
| Disallow | *jbfrp* |
| Disallow | *reviewId%3D* |
| Disallow | *review_id%3D* |
| Allow | /assets/* |
| Allow | /fonts/* |
| Allow | /images/* |
| Allow | /js/* |
| Allow | /uploads/* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | /*.xml |
| Allow | /sitemap* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /add |
| Disallow | /site |
| Disallow | /*login |
| Disallow | /head-hunter/get-widget |
| Disallow | *jbfrp* |
| Disallow | *reviewId%3D* |
| Disallow | *review_id%3D* |
| Allow | /assets/* |
| Allow | /fonts/* |
| Allow | /images/* |
| Allow | /js/* |
| Allow | /uploads/* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | /*.xml |
| Allow | /sitemap* |
*
| Rule | Path |
|---|---|
| Disallow | /add |
| Disallow | /site |
| Disallow | /*login |
| Disallow | /head-hunter/get-widget |
| Disallow | *jbfrp* |
| Disallow | *reviewId%3D* |
| Disallow | *review_id%3D* |
| Allow | /assets/* |
| Allow | /fonts/* |
| Allow | /images/* |
| Allow | /js/* |
| Allow | /uploads/* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Allow | /*.xml |
| Allow | /sitemap* |