finder.work
robots.txt

Robots Exclusion Standard data for finder.work

Resource Scan

Scan Details

Site Domain finder.work
Base Domain finder.work
Scan Status Ok
Last Scan2026-02-28T16:45:22+00:00
Next Scan 2026-03-07T16:45:22+00:00

Last Scan

Scanned2026-02-28T16:45:22+00:00
URL https://finder.work/robots.txt
Domain IPs 45.138.163.165
Response IP 45.138.163.165
Found Yes
Hash cfe45d6be4f8063d78283e3684572d66a59a493f67c2cdc2658c92f65217bf91
SimHash e41510428db1

Groups

googlebot
googlebot-mobile

Rule Path
Disallow *?*
Disallow /*callback
Disallow /personal
Disallow /*managers
Disallow /*profile
Disallow /*favourites
Disallow /*payment
Disallow /vacancies*tariffs
Disallow /*es/new
Disallow /bills
Disallow /responses
Disallow /vacancies/1
Disallow /vacancies/2
Disallow /vacancies/3
Disallow /vacancies/4
Disallow /vacancies/5
Disallow /vacancies/6
Disallow /vacancies/7
Disallow /vacancies/8
Disallow /vacancies/9
Disallow /companies
Allow /*.css?*
Allow /*.js?*
Allow /*.gif?*
Allow /*.jpg?*
Allow /*.jpeg?*
Allow /*.png?*
Allow /*.svg?*
Allow /*.webp?*
Allow /*.woff?*
Allow /*.woff2?*
Allow /*.ttf?*
Allow /*/regions
Allow /vacancies*?page=

*

Rule Path
Disallow *?*
Disallow /*callback
Disallow /personal
Disallow /*managers
Disallow /*profile
Disallow /*favourites
Disallow /*payment
Disallow /vacancies*tariffs
Disallow /*es/new
Disallow /bills
Disallow /responses
Disallow /companies
Allow /*.css?*
Allow /*.js?*
Allow /*.gif?*
Allow /*.jpg?*
Allow /*.jpeg?*
Allow /*.png?*
Allow /*.svg?*
Allow /*.webp?*
Allow /*.woff?*
Allow /*.woff2?*
Allow /*.ttf?*
Allow /*/regions
Allow /vacancies*?page=

Other Records

Field Value
sitemap https://finder.work/sitemap/main.xml

Warnings

  • `host` is not a known field.