ntc-a.ru
robots.txt

Robots Exclusion Standard data for ntc-a.ru

Resource Scan

Scan Details

Site Domain ntc-a.ru
Base Domain ntc-a.ru
Scan Status Ok
Last Scan2025-10-27T06:28:24+00:00
Next Scan 2025-11-26T06:28:24+00:00

Last Scan

Scanned2025-10-27T06:28:24+00:00
URL https://ntc-a.ru/robots.txt
Domain IPs 193.107.238.122
Response IP 193.107.238.122
Found Yes
Hash e5ecd10dad705647d8adf724d6f63aed6f2ef4d41419b7210cb91319b7d32d47
SimHash 4609ccc3e311

Groups

*

Rule Path
Disallow *?*
Disallow /admints/
Disallow /politika/
Disallow /oferta/
Disallow /card/
Disallow /dostavka/
Disallow /rekv/
Disallow /fonts/
Disallow /novosti/*
Disallow */f/*
Allow *.css
Allow *.js
Allow *?page*

googlebot

Rule Path
Disallow *?*
Disallow /admints/
Disallow /politika/
Disallow /oferta/
Disallow /card/
Disallow /rekv/
Disallow /dostavka/
Disallow /fonts/
Disallow /novosti/*
Disallow */f/*
Allow *.css
Allow *.js
Allow *?page*

yandex

Rule Path
Disallow *?*
Disallow /admints/
Disallow /politika/
Disallow /oferta/
Disallow /card/
Disallow /dostavka/
Disallow /fonts/
Disallow /rekv/
Disallow /novosti/*
Disallow */f/*
Allow *.css
Allow *.js
Allow *?page*

gptbot

Rule Path
Disallow /

majestic12.co.uk

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

ia_archiver

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ltx71

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ntc-a.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.