remote-job.ru
robots.txt

Robots Exclusion Standard data for remote-job.ru

Resource Scan

Scan Details

Site Domain remote-job.ru
Base Domain remote-job.ru
Scan Status Ok
Last Scan2024-09-20T02:27:53+00:00
Next Scan 2024-09-27T02:27:53+00:00

Last Scan

Scanned2024-09-20T02:27:53+00:00
URL https://remote-job.ru/robots.txt
Domain IPs 92.53.99.18
Response IP 92.53.99.18
Found Yes
Hash d9c6d768ebf5342eaffa3763ee8fe97b19ac22bc7d1ca9ab5ff4f0bd42527447
SimHash c7008023a314

Groups

*

Rule Path
Disallow /admin
Disallow /virtual
Allow /user/register
Disallow /user
Disallow /cabinet
Disallow /system_tester
Disallow /vacancy/complaints
Disallow /project_management
Disallow /article/requisites
Disallow /user/resetting/send-email

yandex

No rules defined. All paths allowed.

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.