infoteka.biz.ua
robots.txt

Robots Exclusion Standard data for infoteka.biz.ua

Resource Scan

Scan Details

Site Domain infoteka.biz.ua
Base Domain infoteka.biz.ua
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-18T19:04:14+00:00
Next Scan 2025-01-16T19:04:14+00:00

Last Successful Scan

Scanned2023-12-24T18:59:10+00:00
URL https://infoteka.biz.ua/robots.txt
Domain IPs 194.28.86.232
Response IP 194.28.86.232
Found Yes
Hash 66969ec5a414d8d67a8b40157c3ff13b794ebfa5330728fa13cecba0de4d535c
SimHash 4759dc64a3f3

Groups

yandex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 360

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin

yandex

Rule Path
Disallow /wp-admin

paperlibot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php