Log In Sign Up

do.ntspi.ru
robots.txt

Robots Exclusion Standard data for do.ntspi.ru

Resource Scan

Scan Details

Site Domain do.ntspi.ru
Base Domain ntspi.ru
Scan Status Ok
Last Scan2024-09-28T03:54:28+00:00
Next Scan 2024-10-12T03:54:28+00:00

Last Scan

Scanned2024-09-28T03:54:28+00:00
URL https://do.ntspi.ru/robots.txt
Domain IPs 80.64.21.128
Response IP 80.64.21.128
Found Yes
Hash 627fe76c69836ee64cf936d2dc4369c244fcb5ff7df100eae15d9369016fcad7
SimHash 7006ad80888a

Groups

adsbot-google-mobile

Rule Path
Disallow /admin/
Disallow /report/
Disallow /local/opentechnology/tips.php*
Disallow /lib/
Disallow /install/
Disallow /lang/
Disallow /cache/
Disallow /availability/
Disallow /analytics/
Disallow /completion/
Disallow /backup/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /report/
Disallow /local/opentechnology/tips.php*
Disallow /lib/
Disallow /install/
Disallow /lang/
Disallow /cache/
Disallow /availability/
Disallow /analytics/
Disallow /completion/
Disallow /backup/
Back to top

Comments

  • Общее правило
  • Ñ
  • /Ñ
  • Правила для Ads ботов гугла, которые не подпадают под общие
  • Ñ
  • /Ñ
  • Ñ
  • /Ñ
Back to top

Warnings

  • 17 invalid lines.
  • `06pyuser-agent` is not a known field.
Back to top