nn.by
robots.txt

Robots Exclusion Standard data for nn.by

Resource Scan

Scan Details

Site Domain nn.by
Base Domain nn.by
Scan Status Ok
Last Scan2024-10-30T16:27:43+00:00
Next Scan 2024-11-06T16:27:43+00:00

Last Scan

Scanned2024-10-30T16:27:43+00:00
URL https://nn.by/robots.txt
Redirect https://nashaniva.com/robots.txt
Redirect Domain nashaniva.com
Redirect Base nashaniva.com
Domain IPs 104.21.67.147, 172.67.177.89, 2606:4700:3033::ac43:b159, 2606:4700:3037::6815:4393
Redirect IPs 104.21.83.221, 172.67.182.53, 2606:4700:3032::6815:53dd, 2606:4700:3034::ac43:b635
Response IP 104.21.83.221
Found Yes
Hash 4d440bace2fbee892699edd68d2b860e313b9f8d8d5b691a15a994b6c129d92f
SimHash 4a0c95c4e728

Groups

*

Rule Path
Disallow /index.php?c=ar&i=*&p=*&c2=calmonprev&lang=*&combo_calmonth=*&combo_calyear=*
Disallow /?c=arprint&i=*&lang=*
Disallow /index.php?c=ar&i=*&p=*&c2=calmonprev&combo_calmonth=*&combo_calyear=*
Disallow /?c=arprint&i=*
Disallow /?c=ar&i=*&mo=*&lang=ru
Disallow /?c=ar&i=*&mo=*
Disallow /be_arab
Disallow /be_arab/*
Disallow /be_qbel
Disallow /be_qbel/*

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Allow /yandex-news-rss.xml
Allow /yandex-news-rss-be.xml
Allow /yandex-zen-rss.xml

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nashaniva.com/sitemap.xml
sitemap https://nashaniva.com/sitemap2.xml

Warnings

  • `host` is not a known field.