protarif.info
robots.txt

Robots Exclusion Standard data for protarif.info

Resource Scan

Scan Details

Site Domain protarif.info
Base Domain protarif.info
Scan Status Ok
Last Scan2025-11-02T23:53:01+00:00
Next Scan 2025-12-02T23:53:01+00:00

Last Scan

Scanned2025-11-02T23:53:01+00:00
URL https://protarif.info/robots.txt
Redirect https://www.protarif.info/robots.txt
Redirect Domain www.protarif.info
Redirect Base protarif.info
Domain IPs 2a00:f940:2:2:1:1:0:37, 37.140.192.199
Redirect IPs 2a00:f940:2:2:1:1:0:37, 37.140.192.199
Response IP 37.140.192.199
Found Yes
Hash 383a693aff7985296ca62ca448f7abbb70e2273cea56b8b42ad48711181f4a4f
SimHash 450551738d9c

Groups

yandex

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4

stackrambler

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4

*

Rule Path
Allow /rss.xml
Disallow */lenta?page=*
Disallow *page%3D*
Disallow *servise%3D*
Disallow *company%3D*
Disallow *region%3D*
Disallow *main%3D*
Disallow */list?page=*
Disallow *operator%3D*
Disallow *messenger%3D*
Disallow *ball%3D*
Disallow *country%3D*
Disallow *city%3D*
Disallow /administrator/*
Disallow /profile/*
Disallow /ratings/mobile/send.php
Disallow /ratings/messenger/send.php
Disallow /news/update_up.php
Disallow /news/update_up_new.php
Disallow /news/update_down.php
Disallow /news/update_bd.php
Disallow /ratings/mobile/review/update_up_response.php
Disallow /ratings/mobile/review/update_resp_up.php
Disallow /ratings/mobile/review/update_resp_down.php
Disallow /ratings/mobile/review/update_down_response.php
Disallow /ratings/mobile/review/update_comm_bd.php
Disallow /ratings/messenger/review/update_up_response_mess.php
Disallow /ratings/messenger/review/update_resp_mess_up.php
Disallow /ratings/messenger/review/update_resp_mess_down.php
Disallow /ratings/messenger/review/update_down_response_mess.php
Disallow /ratings/messenger/review/update_comm_mess_bd.php
Disallow *send_reg
Disallow *send_reg.php
Disallow *activation.php
Disallow *error404.php
Allow /profile/avatars/user.png

yandexnews

Rule Path
Allow /rss.rss

Other Records

Field Value
sitemap https://www.protarif.info/sitemap.xml

Warnings

  • 3 invalid lines.
  • `host` is not a known field.