ok-english.ru
robots.txt
Robots Exclusion Standard data for ok-english.ru
Resource Scan
Scan Details
| Site Domain | ok-english.ru |
| Base Domain | ok-english.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-03T06:53:10+00:00 |
| Next Scan | 2024-11-10T06:53:10+00:00 |
Last Scan
| Scanned | 2024-11-03T06:53:10+00:00 |
| URL | https://ok-english.ru/robots.txt |
| Domain IPs | 194.39.67.52, fe80::225:90ff:fef4:9a66 |
| Response IP | 194.39.67.52 |
| Found | Yes |
| Hash | fb1675c528b4c6f9b08d63b43eeeced7abbe830d49a42cd9cba9d1e87a5e0070 |
| SimHash | 17154ec24623 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-login.php |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /*?* |
| Disallow | /xmlrpc.php |
aport
baiduspider
barkrowler/0.7
birubot
bingbot
bingbot/2.0
butterfly
camontspider
cliqzbot/2.0
dotbot
extlinksbot
extlinksbot/1.5
ezooms
fairshare
gigabot
httrack
ia_archiver
internetseer
java
js-kit
kmsearchbot
larbin
lwp-trivial
linguee
linkexchanger
libwww
mauibot
mj12bot
mj12bot/v1.4.8
mlbot
mail.ru_bot
mail.ru_bot/2.0
mauibot
nutch
njuicebot
php
postrank
purebot
ptd-crawler
pycurl
semrushbot
semrushbot/2~bl
seekport crawler
sitebot
soup
spbot
surveybot
suggybot
sweb
ttcrawler
user-agent
voyager
wget
wordpress
yeti
yottosbot
zeus
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://ok-english.ru/sitemap.xml |
Warnings
- `host` is not a known field.