Log In Sign Up

qrz.center
robots.txt

Robots Exclusion Standard data for qrz.center

Resource Scan

Scan Details

Site Domain qrz.center
Base Domain qrz.center
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-16T06:31:19+00:00
Next Scan 2024-11-17T06:31:19+00:00

Last Successful Scan

Scanned2024-10-17T05:45:52+00:00
URL https://qrz.center/robots.txt
Domain IPs 104.21.7.238, 172.67.156.139, 2606:4700:3032::ac43:9c8b, 2606:4700:3035::6815:7ee
Response IP 104.21.7.238
Found Yes
Hash f12bc14058c3fa5841cf8df95b9a899d25cd2b6fbe57ddd97efc86dd6116aee8
SimHash 13b4d43668a2

Groups

yandex

Rule Path
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*/msg
Disallow /*msg*
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

mail.ru

Rule Path
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

googlebot-mobile

Rule Path
Allow /wap2/
Allow /wap/
Allow /*wap2*
Allow /*wap*
Allow /*imode*
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

yandeximageresizer

Rule Path
Allow /wap2/
Allow /wap/
Allow /*wap2*
Allow /*wap*
Allow /*imode*
Disallow /111/
Disallow /777/
Disallow /attachments/
Disallow /avatars/
Disallow /cache/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /downloads/
Disallow /editor_thumbnails/
Disallow /editor_uploads/
Disallow /fckeditor/
Disallow /images/
Disallow /mgal_data/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /useravatar/
Disallow /*register*
Disallow /*register2*
Disallow /mlist/
Disallow /who/
Disallow /profile/
Disallow /moderate/
Disallow /*action%3Dadmin*
Disallow /*action%3Dhelp*
Disallow /*action%3Dsearch*
Disallow /*sendtopic/
Disallow /*shoutbox*
Disallow /go.php
Disallow /*action%3Dgo*
Disallow /*.msg
Disallow /*msg
Disallow /*msg*
Disallow /*/msg
Disallow /*new
Disallow /*/new
Disallow /*prev_next*
Disallow /*PHPSESSID*

Other Records

Field Value
crawl-delay 10

sputnikbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/1.2~bl

Rule Path
Disallow /

mozilla/5.0 (compatible; semrushbot/2~bl; +http://www.semrush.com/bot.html)

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

scrapy/1.5.0

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

velenpublicwebcrawler (velen.io)

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

pcore-http

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

crawler.feedback+wc@gmail.com

Rule Path
Disallow /

cyotekwebcopy/1.0

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

crawler (crawler.feedback@gmail.com)

Rule Path
Disallow /

crawler

Rule Path
Disallow /

barkrowler/0.7 (+http://www.exensa.com/crawl)

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

test crawl

Rule Path
Disallow /

scalaj-http/1.0

Rule Path
Disallow /

bubing

Rule Path
Disallow /

wotbox/2.01

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ebibot

Rule Path
Disallow /

pcore-http/v0.24.5

Rule Path
Disallow /

testitest1

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

istellabot/t.1

Rule Path
Disallow /

istellabot/t.1.13

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

booglebot2

Rule Path
Disallow /

booglebot

Rule Path
Disallow /

booglebot 2.0

Rule Path
Disallow /

booglebot/2.0

Rule Path
Disallow /

mj12bot/v1.0.5

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

influencebo

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

businessdbbot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rogerbot/1.0

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

swebot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

www.80legs.com

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

comodospider

Rule Path
Disallow /

comodospider/nutch-1.2

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

icarus6

Rule Path
Disallow /

icarus6

Rule Path
Disallow /

icarus

Rule Path
Disallow /

icarus

Rule Path
Disallow /

icarus6j

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

knelson

Rule Path
Disallow /

knelson/0.9

Rule Path
Disallow /

wotbox/2.01

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

qwantify

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
sitemap https://qrz.center/index.php?action=sitemap;xml
Back to top

Comments

  • Для мобильных
  • Запрет на индексацию сайта всех кроме Yandex, Googlebot и Mail.Ru
  • User-agent: *
  • Disallow: /
Back to top

Warnings

  • 10 invalid lines.
  • `host` is not a known field.
Back to top