svetofor-l.ru
robots.txt

Robots Exclusion Standard data for svetofor-l.ru

Resource Scan

Scan Details

Site Domain svetofor-l.ru
Base Domain svetofor-l.ru
Scan Status Ok
Last Scan2024-09-07T15:26:13+00:00
Next Scan 2024-10-07T15:26:13+00:00

Last Scan

Scanned2024-09-07T15:26:13+00:00
URL https://svetofor-l.ru/robots.txt
Domain IPs 194.117.250.40
Response IP 194.117.250.40
Found Yes
Hash af139aa007c03301fd25ee1b81a8639d566258d81788a104be053a87b6b3b5af
SimHash 4a0dd569c898

Groups

yandex

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/

slurp

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.4.5

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

mosbookmarks

Rule Path
Disallow /

mj12bot/v1.4.7

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

riddler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.4.5

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/

Other Records

Field Value
sitemap https://svetofor-l.ru/sitemap.xml

Warnings

  • `host` is not a known field.