Log In Sign Up

qrz.center
robots.txt

Robots Exclusion Standard data for qrz.center

Resource Scan

Scan Details

Site Domain qrz.center
Base Domain qrz.center
Scan Status Ok
Last Scan2024-06-11T18:25:01+00:00
Next Scan 2024-07-11T18:25:01+00:00

Last Scan

Scanned2024-06-11T18:25:01+00:00
URL https://qrz.center/robots.txt
Domain IPs 104.21.7.238, 172.67.156.139, 2606:4700:3032::ac43:9c8b, 2606:4700:3035::6815:7ee
Response IP 172.67.156.139
Found Yes
Hash f12bc14058c3fa5841cf8df95b9a899d25cd2b6fbe57ddd97efc86dd6116aee8
SimHash 13b4d43668a2

Groups

yandex

Rule Path
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*/msg
Disallow /*msg*
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

mail.ru

Rule Path
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

googlebot-mobile

Rule Path
Allow /wap2/
Allow /wap/
Allow /*wap2*
Allow /*wap*
Allow /*imode*
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

yandeximageresizer

Rule Path
Allow /wap2/
Allow /wap/
Allow /*wap2*
Allow /*wap*
Allow /*imode*
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

sputnikbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

mozilla/5.0 (compatible; semrushbot/2~bl; +http://www.semrush.com/bot.html)

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

scrapy/1.5.0

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

velenpublicwebcrawler (velen.io)

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

pcore-http

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

crawler.feedback+wc@gmail.com

Rule Path
Disallow /

cyotekwebcopy/1.0

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

crawler (crawler.feedback@gmail.com)

Rule Path
Disallow /

crawler

Rule Path
Disallow /

barkrowler/0.7 (+http://www.exensa.com/crawl)

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

test crawl

Rule Path
Disallow /

scalaj-http/1.0

Rule Path
Disallow /

bubing

Rule Path
Disallow /

wotbox/2.01

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ebibot

Rule Path
Disallow /

pcore-http/v0.24.5

Rule Path
Disallow /

testitest1

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

istellabot/t.1

Rule Path
Disallow /

istellabot/t.1.13

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

booglebot2

Rule Path
Disallow /

booglebot

Rule Path
Disallow /

booglebot 2.0

Rule Path
Disallow /

booglebot/2.0

Rule Path
Disallow /

mj12bot/v1.0.5

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

influencebo

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

businessdbbot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rogerbot/1.0

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

swebot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

www.80legs.com

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

comodospider

Rule Path
Disallow /

comodospider/nutch-1.2

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

icarus6

Rule Path
Disallow /

icarus6

Rule Path
Disallow /

icarus

Rule Path
Disallow /

icarus

Rule Path
Disallow /

icarus6j

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

knelson

Rule Path
Disallow /

knelson/0.9

Rule Path
Disallow /

wotbox/2.01

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

qwantify

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
Back to top

Comments

  • Для мобильных
  • Запрет на индексацию сайта всех кроме Yandex, Googlebot и Mail.Ru
  • User-agent: *
  • Disallow: /
Back to top

Warnings

  • 10 invalid lines.
  • `host` is not a known field.
Back to top