c1682.c.3072.ru
robots.txt

Robots Exclusion Standard data for c1682.c.3072.ru

Resource Scan

Scan Details

Site Domain c1682.c.3072.ru
Base Domain 3072.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-09-28T02:17:16+00:00
Next Scan 2024-10-12T02:17:16+00:00

Last Successful Scan

Scanned2024-09-05T22:36:52+00:00
URL https://c1682.c.3072.ru/robots.txt
Domain IPs 185.164.173.24
Response IP 185.164.173.24
Found Yes
Hash 627fe76c69836ee64cf936d2dc4369c244fcb5ff7df100eae15d9369016fcad7
SimHash 7006ad80888a

Groups

adsbot-google-mobile

Rule Path
Disallow /admin/
Disallow /report/
Disallow /local/opentechnology/tips.php*
Disallow /lib/
Disallow /install/
Disallow /lang/
Disallow /cache/
Disallow /availability/
Disallow /analytics/
Disallow /completion/
Disallow /backup/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /report/
Disallow /local/opentechnology/tips.php*
Disallow /lib/
Disallow /install/
Disallow /lang/
Disallow /cache/
Disallow /availability/
Disallow /analytics/
Disallow /completion/
Disallow /backup/

Comments

  • Общее правило
  • Ñ
  • Правила для Ads ботов гугла, которые не подпадают под общие
  • Ñ
  • Ñ

Warnings

  • 17 invalid lines.
  • `06pyuser-agent` is not a known field.