scenarii.ru
robots.txt
Robots Exclusion Standard data for scenarii.ru
Resource Scan
Scan Details
| Site Domain | scenarii.ru |
| Base Domain | scenarii.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-04T01:39:14+00:00 |
| Next Scan | 2024-08-02T01:39:14+00:00 |
Last Successful Scan
| Scanned | 2023-09-14T20:18:31+00:00 |
| URL | https://scenarii.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:4dcc, 2a00:15f8:a000:5:1:12:0:4dcc, 2a00:15f8:a000:5:1:13:0:4dcc, 2a00:15f8:a000:5:1:14:0:4dcc, 90.156.201.108, 90.156.201.12, 90.156.201.37, 90.156.201.97 |
| Response IP | 90.156.201.37 |
| Found | Yes |
| Hash | 8d58a24348b084fababe4d0d77ffc425a70a2c14d3dae92c9d881127cf741861 |
| SimHash | 51160be09ce8 |
Groups
adsbot
ahrefsbot
amazonadbot
antivirusbot
applebot
aylienbot
bdcbot
bingbot
blexbot
blexbottest
bot
carianbot
cliqzbot
coccocbot-web
codewisebot
dataforseobot
dnyzbot
dotbot
duckduckgo-favicons-bot
etoolsbot
everyonesocialbot
exabot
extlinksbot
eyeotabot
facebot twitterbot
findxbot
flimbbot
flinkhubbot
idbot
istellabot
kazbtbot
komodiabot
konturbot
kstandbot
laserlikebot
lastmodbot
leikibot
letsearchbot
linkdexbot
linkpadbot
ltbot
mail.ru_bot
maildbbot
meanpathbot
mediamathbot
meta_bot
microadbot
mixrankbot
mj12bot
msnbot-media
neevabot
netpeakcheckerbot
nimbostratus-bot
nsrbot
obot
odklbot
openhosebot
paperlibot
petalbot
pingrelyrobot
pinterestbot
privacyawarebot
redditbot
researchbot
robot
rogerbot
safecontentbot
seekportbot
semrushbot
semrushbot-si
seokicks-robot
seoutilsbot
seznambot
smtbot
snappreviewbot
spbot
sputnikbot
sputnikfaviconbot
sputnikimagebot
statonlinerubot
streamline3bot
sukibot_heritrix
surdotlybot
surveybot
tineye-bot
tobbot
trendictionbot
tsearchbot
twitterbot
twmbot
umbot-ln
uptimebot
vebidoobot
voluumdsp-content-bot
wbsearchbot
webartexbot
wellknownbot
whatcmsbot
whoiswebsitebot
xovibot
yesupbot
zombiebot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /scenario/link.php* |
| Disallow | /article/* |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://scenarii.ru/wp-sitemap.xml |