online2.mospolytech.ru
robots.txt

Robots Exclusion Standard data for online2.mospolytech.ru

Resource Scan

Scan Details

Site Domain online2.mospolytech.ru
Base Domain mospolytech.ru
Scan Status Ok
Last Scan2024-09-19T12:58:59+00:00
Next Scan 2024-10-19T12:58:59+00:00

Last Scan

Scanned2024-09-19T12:58:59+00:00
URL http://online2.mospolytech.ru/robots.txt
Redirect https://online.mospolytech.ru/robots.txt
Redirect Domain online.mospolytech.ru
Redirect Base mospolytech.ru
Domain IPs 178.154.245.18
Redirect IPs 178.248.239.239
Response IP 178.248.239.239
Found Yes
Hash 627fe76c69836ee64cf936d2dc4369c244fcb5ff7df100eae15d9369016fcad7
SimHash 7006ad80888a

Groups

adsbot-google-mobile

Rule Path
Disallow /admin/
Disallow /report/
Disallow /local/opentechnology/tips.php*
Disallow /lib/
Disallow /install/
Disallow /lang/
Disallow /cache/
Disallow /availability/
Disallow /analytics/
Disallow /completion/
Disallow /backup/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /report/
Disallow /local/opentechnology/tips.php*
Disallow /lib/
Disallow /install/
Disallow /lang/
Disallow /cache/
Disallow /availability/
Disallow /analytics/
Disallow /completion/
Disallow /backup/

Comments

  • Общее правило
  • Ñ
  • Правила для Ads ботов гугла, которые не подпадают под общие
  • Ñ
  • Ñ

Warnings

  • 17 invalid lines.
  • `06pyuser-agent` is not a known field.