31tv.ru
robots.txt

Robots Exclusion Standard data for 31tv.ru

Resource Scan

Scan Details

Site Domain 31tv.ru
Base Domain 31tv.ru
Scan Status Ok
Last Scan2024-06-24T12:21:36+00:00
Next Scan 2024-07-01T12:21:36+00:00

Last Scan

Scanned2024-06-24T12:21:36+00:00
URL https://31tv.ru/robots.txt
Domain IPs 104.21.84.165, 172.67.195.61, 2606:4700:3030::6815:54a5, 2606:4700:3036::ac43:c33d
Response IP 172.67.195.61
Found Yes
Hash f2ed0f7d71af2e060fa18681a26606a20e6685799cc80991eea7a61c199ff63d
SimHash 4e7adf349b36

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2.0

*

Rule Path
Disallow /programs/gen-molodosti/
Disallow /programs/specproekty/
Disallow /programs/poleznaja-programma/
Disallow /programs/ja-chitaju/
Disallow /programs/teleproekt-kadry/
Disallow /programs/v-strane-i-mire/
Disallow /programs/deputatskij-vestnik/
Disallow /programs/chas-s-generalom-sergeevym/
Disallow /programs/kommunalnyj-kontrol/
Disallow /programs/istory/
Disallow /programs/ja-sovershenstvo/
Disallow /programs/ochen-modnoe-puteshestvie/
Disallow /programs/avtostrada/
Disallow /programs/novosti-partnerov/
Disallow /programs/life/
Disallow /programs/juridicheskij-perevodchik/
Disallow /programs/koronavirus-na-yujnom-urale/