astrahan.apela.ru
robots.txt

Robots Exclusion Standard data for astrahan.apela.ru

Resource Scan

Scan Details

Site Domain astrahan.apela.ru
Base Domain apela.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-03-04T04:33:44+00:00
Next Scan 2026-06-02T04:33:44+00:00

Last Successful Scan

Scanned2024-07-19T19:37:10+00:00
URL http://astrahan.apela.ru/robots.txt
Domain IPs 46.17.41.188
Response IP 46.17.41.188
Found Yes
Hash f6a69c533f841f835816bd24a2a6991273d705c1997af306d75a0131584ee1db
SimHash 6a1d88e0eb9b

Groups

yandex

Rule Path
Disallow /search

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /search

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /