zabort.ru
robots.txt

Robots Exclusion Standard data for zabort.ru

Resource Scan

Scan Details

Site Domain zabort.ru
Base Domain zabort.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-04T16:45:48+00:00
Next Scan 2025-07-03T16:45:48+00:00

Last Successful Scan

Scanned2022-09-22T09:59:35+00:00
URL https://zabort.ru/robots.txt
Response IP 104.21.14.179
Found Yes
Hash 7619fcffc3b57d45de6c3f3ed2a426c7c90c61a03e3b140043bc377489a563a5
SimHash 6e14dc30f601

Groups

*

Rule Path
Disallow /link/
Disallow /rss/
Disallow /blog/creative/7840.html
Disallow /?q
Disallow /?qq
Disallow /cdn-cgi/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Warnings

  • `host` is not a known field.