Log In Sign Up

naukanet.ru
robots.txt

Robots Exclusion Standard data for naukanet.ru

Resource Scan

Scan Details

Site Domain naukanet.ru
Base Domain naukanet.ru
Scan Status Ok
Last Scan2024-10-21T10:35:05+00:00
Next Scan 2024-11-20T10:35:05+00:00

Last Scan

Scanned2024-10-21T10:35:05+00:00
URL https://naukanet.ru/robots.txt
Domain IPs 95.181.181.96
Response IP 95.181.181.96
Found Yes
Hash 4224eb49bf8366cf320032422e7c0c52014503e5ddc3f5a53b74113db1b0c7ef
SimHash 1b54c260a5d2

Groups

abonti

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

admantx

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /

afd-verbotsverfahren

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aibot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

alittle client

Rule Path
Disallow /

alligator

Rule Path
Disallow /

allsubmitter

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

anarchie

Rule Path
Disallow /

anarchy

Rule Path
Disallow /

anarchy99

Rule Path
Disallow /

ankit

Rule Path
Disallow /

anthill

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

apexoo

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

arquivo.pt

Rule Path
Disallow /

aspiegel

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

asterias

Rule Path
Disallow /

atomseobot

Rule Path
Disallow /

attach

Rule Path
Disallow /

autoemailspider

Rule Path
Disallow /

awario.com

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Warnings

  • 10 invalid lines.
Back to top