lunfardo.academic.ru
robots.txt

Robots Exclusion Standard data for lunfardo.academic.ru

Resource Scan

Scan Details

Site Domain lunfardo.academic.ru
Base Domain academic.ru
Scan Status Ok
Last Scan2024-09-22T18:14:22+00:00
Next Scan 2024-10-22T18:14:22+00:00

Last Scan

Scanned2024-09-22T18:14:22+00:00
URL https://lunfardo.academic.ru/robots.txt
Domain IPs 135.181.143.237, 135.181.160.175, 135.181.177.163, 2a01:4f9:3a:1792::2, 2a01:4f9:3a:1850::2, 2a01:4f9:3a:1f9e::2, 2a01:4f9:c01e:78::1, 95.217.170.197
Response IP 135.181.177.163
Found Yes
Hash 51e73b17d00cc85e631410a735069452dd9edf67a3a9e3c660204039ad6af381
SimHash 563ccc624a8a

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 0.1

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

knowledge ai

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow *

Other Records

Field Value
sitemap https://lunfardo.academic.ru/sitemaps/academic.ru/lunfardo_index.xml