blog.4colors.ru
robots.txt

Robots Exclusion Standard data for blog.4colors.ru

Resource Scan

Scan Details

Site Domain blog.4colors.ru
Base Domain 4colors.ru
Scan Status Ok
Last Scan2025-11-12T14:25:33+00:00
Next Scan 2025-12-12T14:25:33+00:00

Last Scan

Scanned2025-11-12T14:25:33+00:00
URL https://blog.4colors.ru/robots.txt
Domain IPs 45.130.41.89
Response IP 45.130.41.89
Found Yes
Hash e2035be4949a4cb12fc52bb78120a88132def9e356e3f3aa37bfb2eac8f2f007
SimHash 311005464e9b

Groups

*

Rule Path
Disallow /assets/backup/
Disallow /assets/cache/
Disallow /assets/docs/
Disallow /assets/export/
Disallow /assets/files/
Disallow /assets/flash/
Disallow /assets/images/
Disallow /assets/import/
Disallow /assets/modules/
Disallow /assets/packages/
Disallow /assets/plugins/
Disallow /assets/snippets/
Disallow /assets/templates/
Disallow /assets/tvs/
Disallow /assets/widgets/
Disallow /assets/.thumbs/
Disallow /index
Disallow /install/
Disallow /manager/
Disallow /search%3D*
Disallow /search
Disallow /search.html
Disallow /?
Disallow /*?
Disallow /*?id=
Disallow /*?*start=0$
Disallow /401.html
Disallow /403.html
Disallow /403.html
Disallow /410.html
Allow /assets/cache/images/
Allow /assets/images/articles_img/
Allow /assets/images/promo_img/
Allow /assets/images/News/
Allow /assets/images/medium/
Allow /assets/images/mini/
Allow /assets/modules/*.css
Allow /assets/modules/*.js
Allow /assets/plugins/*.css
Allow /assets/plugins/*.js
Allow /assets/snippets/*.css
Allow /assets/snippets/*.js
Allow /assets/templates/*.css
Allow /assets/templates/*.js
Allow /assets/templates/*.jpg
Allow /assets/templates/*.png
Allow /assets/templates/*.gif

ahrefsbot

Rule Path
Disallow /

aport

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/3.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/4.0; +http://www.baidu.com/search/spider.html)
mozilla/5.0 (compatible; baiduspider/5.0; +http://www.baidu.com/search/spider.html)
baiduspider/2.0
baiduspider/3.0
baiduspider/4.0
baiduspider/5.0

Rule Path
Disallow /

msnbot/bingbot
bingbot
msnbot

Rule Path
Disallow /

blexbot
mozilla/5.0 (compatible; blexbot/1.0; +http://webmeup-crawler.com/)

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

dolphin

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

lycos

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scooter

Rule Path
Disallow /

semrushbot
semrushbot/0.98
semrushbot-sa

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

spbot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

yanga

Rule Path
Disallow /

yioopbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://blog.4colors.ru/sitemap.xml

Comments

  • Default modx exclusions

Warnings

  • `host` is not a known field.