nvworld.ru
robots.txt

Robots Exclusion Standard data for nvworld.ru

Resource Scan

Scan Details

Site Domain nvworld.ru
Base Domain nvworld.ru
Scan Status Ok
Last Scan2024-10-02T06:10:48+00:00
Next Scan 2024-10-09T06:10:48+00:00

Last Scan

Scanned2024-10-02T06:10:48+00:00
URL https://nvworld.ru/robots.txt
Domain IPs 195.201.38.102
Response IP 195.201.38.102
Found Yes
Hash 60c47223ee37fc60c8f61ea35269146f439e195e12e4697b5466504f19e5d15b
SimHash 1adc93508d81

Groups

*

Rule Path
Disallow *?
Disallow /abbr/
Disallow /information/feedback/
Disallow /search/
Disallow /faq/*/vote/
Disallow /js/sh
Disallow /js/min/sh
Disallow /js/abbrs
Disallow /js/min/abbrs
Disallow /mousetrap/
Disallow /cgi-bin/
Disallow /*/tags/*/*/*/*/*/*/
Disallow /drivers/tags/*/*/
Disallow /kb/similar/*/*/*/
Disallow /wizard/similar/*/*/*/
Disallow /utilities/creator/*/tags/*/*/
Disallow *.php
Disallow *.cgi
Disallow *.json
Disallow /_/

yandex

Rule Path
Disallow /abbr/
Disallow /information/feedback/
Disallow /search/
Disallow */rss/*
Disallow */chapter
Disallow *%23
Disallow /files/
Allow /files/*.jpg
Allow /files/*.png
Allow /files/*.gif
Disallow *?
Disallow /faq/*/vote/
Disallow /js/sh
Disallow /js/min/sh
Disallow /js/abbrs
Disallow /js/min/abbrs
Disallow /mousetrap/
Disallow /cgi-bin/
Disallow /*/tags/*/*/*/*/*/*/
Disallow /drivers/tags/*/*/
Disallow /kb/similar/*/*/*/
Disallow /wizard/similar/*/*/*/
Disallow /utilities/creator/*/tags/*/*/
Disallow *.json$
Disallow *.php
Disallow *.cgi
Disallow /_/

searchbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

daum

Rule Path
Disallow /

deusu

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdao

Rule Path
Disallow /

goo

Rule Path
Disallow /

ntentbot-fetch

Rule Path
Disallow /

ntentbot-news

Rule Path
Disallow /

eracrawler

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

buck

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nvworld.ru/news/map.xml
sitemap https://nvworld.ru/news/days.xml
sitemap https://nvworld.ru/news/tags.xml
sitemap https://nvworld.ru/faq/map.xml
sitemap https://nvworld.ru/faq/tags.xml
sitemap https://nvworld.ru/articles/map.xml
sitemap https://nvworld.ru/articles/tags.xml
sitemap https://nvworld.ru/utilities/map.xml
sitemap https://nvworld.ru/utilities/tags.xml
sitemap https://nvworld.ru/drivers/map.xml
sitemap https://nvworld.ru/drivers/tags.xml
sitemap https://nvworld.ru/kb/map.xml
sitemap https://nvworld.ru/wizard/map.xml

Warnings

  • 2 invalid lines.