job-piter.ru
robots.txt

Robots Exclusion Standard data for job-piter.ru

Resource Scan

Scan Details

Site Domain job-piter.ru
Base Domain job-piter.ru
Scan Status Ok
Last Scan2024-06-22T09:12:44+00:00
Next Scan 2024-06-29T09:12:44+00:00

Last Scan

Scanned2024-06-22T09:12:44+00:00
URL https://job-piter.ru/robots.txt
Domain IPs 46.19.66.65
Response IP 46.19.66.65
Found Yes
Hash 7c8c9bd6f3aebf9b9b45e5e11f9a57ba8c4afb56c24b616fde06b45133f894da
SimHash 4b488843e7b0

Groups

*

Rule Path
Disallow /cron

yandex

Rule Path
Disallow /cron

Other Records

Field Value
sitemap https://job-piter.ru/sitemap/index.xml

Warnings

  • `host` is not a known field.