scenarii.ru
robots.txt
Robots Exclusion Standard data for scenarii.ru
Resource Scan
Scan Details
Site Domain | scenarii.ru |
Base Domain | scenarii.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-31T01:39:33+00:00 |
Next Scan | 2025-01-29T01:39:33+00:00 |
Last Successful Scan
Scanned | 2023-09-14T20:18:31+00:00 |
URL | https://scenarii.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:0:4dcc, 2a00:15f8:a000:5:1:12:0:4dcc, 2a00:15f8:a000:5:1:13:0:4dcc, 2a00:15f8:a000:5:1:14:0:4dcc, 90.156.201.108, 90.156.201.12, 90.156.201.37, 90.156.201.97 |
Response IP | 90.156.201.37 |
Found | Yes |
Hash | 8d58a24348b084fababe4d0d77ffc425a70a2c14d3dae92c9d881127cf741861 |
SimHash | 51160be09ce8 |
Groups
adsbot
ahrefsbot
amazonadbot
antivirusbot
applebot
aylienbot
bdcbot
bingbot
blexbot
blexbottest
bot
carianbot
cliqzbot
coccocbot-web
codewisebot
dataforseobot
dnyzbot
dotbot
duckduckgo-favicons-bot
etoolsbot
everyonesocialbot
exabot
extlinksbot
eyeotabot
facebot twitterbot
findxbot
flimbbot
flinkhubbot
idbot
istellabot
kazbtbot
komodiabot
konturbot
kstandbot
laserlikebot
lastmodbot
leikibot
letsearchbot
linkdexbot
linkpadbot
ltbot
mail.ru_bot
maildbbot
meanpathbot
mediamathbot
meta_bot
microadbot
mixrankbot
mj12bot
msnbot-media
neevabot
netpeakcheckerbot
nimbostratus-bot
nsrbot
obot
odklbot
openhosebot
paperlibot
petalbot
pingrelyrobot
pinterestbot
privacyawarebot
redditbot
researchbot
robot
rogerbot
safecontentbot
seekportbot
semrushbot
semrushbot-si
seokicks-robot
seoutilsbot
seznambot
smtbot
snappreviewbot
spbot
sputnikbot
sputnikfaviconbot
sputnikimagebot
statonlinerubot
streamline3bot
sukibot_heritrix
surdotlybot
surveybot
tineye-bot
tobbot
trendictionbot
tsearchbot
twitterbot
twmbot
umbot-ln
uptimebot
vebidoobot
voluumdsp-content-bot
wbsearchbot
webartexbot
wellknownbot
whatcmsbot
whoiswebsitebot
xovibot
yesupbot
zombiebot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /scenario/link.php* |
Disallow | /article/* |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://scenarii.ru/wp-sitemap.xml |