d3kcf2pe5t7rrb.cloudfront.net
robots.txt

Robots Exclusion Standard data for d3kcf2pe5t7rrb.cloudfront.net

Resource Scan

Scan Details

Site Domain d3kcf2pe5t7rrb.cloudfront.net
Base Domain d3kcf2pe5t7rrb.cloudfront.net
Scan Status Ok
Last Scan2024-09-25T22:19:24+00:00
Next Scan 2024-10-02T22:19:24+00:00

Last Scan

Scanned2024-09-25T22:19:24+00:00
URL https://d3kcf2pe5t7rrb.cloudfront.net/robots.txt
Domain IPs 13.226.4.16, 13.226.4.168, 13.226.4.212, 13.226.4.5, 2600:9000:269a:3000:16:5dc6:51c0:21, 2600:9000:269a:5c00:16:5dc6:51c0:21, 2600:9000:269a:5e00:16:5dc6:51c0:21, 2600:9000:269a:7600:16:5dc6:51c0:21, 2600:9000:269a:7a00:16:5dc6:51c0:21, 2600:9000:269a:ae00:16:5dc6:51c0:21, 2600:9000:269a:d400:16:5dc6:51c0:21, 2600:9000:269a:fc00:16:5dc6:51c0:21
Response IP 18.165.121.34
Found Yes
Hash 4d440bace2fbee892699edd68d2b860e313b9f8d8d5b691a15a994b6c129d92f
SimHash 4a0c95c4e728

Groups

*

Rule Path
Disallow /index.php?c=ar&i=*&p=*&c2=calmonprev&lang=*&combo_calmonth=*&combo_calyear=*
Disallow /?c=arprint&i=*&lang=*
Disallow /index.php?c=ar&i=*&p=*&c2=calmonprev&combo_calmonth=*&combo_calyear=*
Disallow /?c=arprint&i=*
Disallow /?c=ar&i=*&mo=*&lang=ru
Disallow /?c=ar&i=*&mo=*
Disallow /be_arab
Disallow /be_arab/*
Disallow /be_qbel
Disallow /be_qbel/*

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Allow /yandex-news-rss.xml
Allow /yandex-news-rss-be.xml
Allow /yandex-zen-rss.xml

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nashaniva.com/sitemap.xml
sitemap https://nashaniva.com/sitemap2.xml

Warnings

  • `host` is not a known field.