colovrat.org
robots.txt
Robots Exclusion Standard data for colovrat.org
Resource Scan
Scan Details
Site Domain | colovrat.org |
Base Domain | colovrat.org |
Scan Status | Ok |
Last Scan | 2024-09-21T20:47:11+00:00 |
Next Scan | 2024-09-28T20:47:11+00:00 |
Last Scan
Scanned | 2024-09-21T20:47:11+00:00 |
URL | https://colovrat.org/robots.txt |
Domain IPs | 192.243.57.17 |
Response IP | 192.243.57.17 |
Found | Yes |
Hash | 550034dbcf126d6d97bfa9d48b739749cfc045a25d1f79359f6bc1b85408aba4 |
SimHash | 4cfa05817f1b |
Groups
*
Rule | Path |
---|---|
Allow | /*?ref= |
Allow | /*.jpg |
Allow | /*.png |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.html |
Allow | |
Allow | /*.js |
Allow | /*.css |
Allow | /*.doc |
Allow | /*.docx |
Allow | /*.ttf |
Allow | /*.woff |
Allow | /*.woff2 |
Allow | /*.eot |
Allow | /bibliotheca/feed.rss |
Allow | /edu/feed.rss |
Allow | /dir/rssya_turbo |
Allow | /publ/rssya_turbo |
Allow | /load/rssya_turbo |
Allow | /board/rssya_turbo |
Allow | /blog/rssya_turbo |
Allow | /news/rssya_turbo |
Allow | /dir/rssya |
Allow | /publ/rssya |
Allow | /load/rssya |
Allow | /board/rssya |
Allow | /blog/rssya |
Allow | /news/rssya |
Allow | /video/rssya |
Allow | /photo/rssya |
Allow | /stuff/rssya |
Allow | /dir/rssya_zen |
Allow | /publ/rssya_zen |
Allow | /load/rssya_zen |
Allow | /board/rssya_zen |
Allow | /blog/rssya_zen |
Allow | /news/rssya_zen |
Allow | /video/rssya_zen |
Allow | /photo/rssya_zen |
Allow | /stuff/rssya_zen |
Allow | /blog/feedya |
Allow | /news/feedya |
Allow | /go? |
Disallow | /*?page |
Disallow | /a/ |
Disallow | /stat/ |
Disallow | /index/1 |
Disallow | /index/3 |
Disallow | /index/5 |
Disallow | /index/7 |
Disallow | /index/8 |
Disallow | /index/9 |
Disallow | /register |
Disallow | /confirm/ |
Disallow | /index/sub/ |
Disallow | /panel/ |
Disallow | /admin/ |
Disallow | /informer/ |
Disallow | /secure/ |
Disallow | /poll/ |
Disallow | /search/ |
Disallow | /bibliotheca/search.html |
Disallow | /edu/search.html |
Disallow | /video/chu |
Disallow | /video/cha |
Disallow | /mchat |
Disallow | /abnl/ |
Disallow | /*_escaped_fragment_%3D |
Disallow | /*-*-*-*-987$ |
Disallow | /?ssid= |
Disallow | /*-0-0- |
Disallow | /*0-*-0-17$ |
Disallow | /js/ |
Disallow | /*? |
Disallow | /rtr/ |
Disallow | /*-$ |
Disallow | /*%26* |
yandex
Rule | Path |
---|---|
Allow | /*?ref= |
Allow | /*.jpg |
Allow | /*.png |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.html |
Allow | |
Allow | /*.js |
Allow | /*.css |
Allow | /*.doc |
Allow | /*.docx |
Allow | /*.ttf |
Allow | /*.woff |
Allow | /*.woff2 |
Allow | /*.eot |
Allow | /bibliotheca/feed.rss |
Allow | /edu/feed.rss |
Allow | /dir/rssya_turbo |
Allow | /publ/rssya_turbo |
Allow | /load/rssya_turbo |
Allow | /board/rssya_turbo |
Allow | /blog/rssya_turbo |
Allow | /news/rssya_turbo |
Allow | /dir/rssya |
Allow | /publ/rssya |
Allow | /load/rssya |
Allow | /board/rssya |
Allow | /blog/rssya |
Allow | /news/rssya |
Allow | /video/rssya |
Allow | /photo/rssya |
Allow | /stuff/rssya |
Allow | /dir/rssya_zen |
Allow | /publ/rssya_zen |
Allow | /load/rssya_zen |
Allow | /board/rssya_zen |
Allow | /blog/rssya_zen |
Allow | /news/rssya_zen |
Allow | /video/rssya_zen |
Allow | /photo/rssya_zen |
Allow | /stuff/rssya_zen |
Allow | /blog/feedya |
Allow | /news/feedya |
Allow | /go? |
Disallow | /*?page |
Disallow | /a/ |
Disallow | /stat/ |
Disallow | /index/1 |
Disallow | /index/3 |
Disallow | /index/5 |
Disallow | /index/7 |
Disallow | /index/8 |
Disallow | /index/9 |
Disallow | /register |
Disallow | /confirm/ |
Disallow | /index/sub/ |
Disallow | /panel/ |
Disallow | /admin/ |
Disallow | /informer/ |
Disallow | /secure/ |
Disallow | /poll/ |
Disallow | /search/ |
Disallow | /bibliotheca/search.html |
Disallow | /edu/search.html |
Disallow | /video/chu |
Disallow | /video/cha |
Disallow | /mchat |
Disallow | /abnl/ |
Disallow | /*_escaped_fragment_%3D |
Disallow | /*-*-*-*-987$ |
Disallow | /?ssid= |
Disallow | /*-0-0- |
Disallow | /*0-*-0-17$ |
Disallow | /js/ |
Disallow | /*? |
Disallow | /rtr/ |
Disallow | /*-$ |
Disallow | /*%26* |
googlebot
Rule | Path |
---|---|
Allow | /*?ref= |
Allow | /*.jpg |
Allow | /*.png |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.html |
Allow | |
Allow | /*.js |
Allow | /*.css |
Allow | /*.doc |
Allow | /*.docx |
Allow | /*.ttf |
Allow | /*.woff |
Allow | /*.woff2 |
Allow | /*.eot |
Allow | /bibliotheca/ |
Allow | /edu/ |
Allow | /dir/ |
Allow | /publ/ |
Allow | /load/ |
Allow | /board/ |
Allow | /blog/ |
Allow | /news/ |
Allow | /video/ |
Allow | /photo/ |
Allow | /stuff/ |
Allow | /go? |
Disallow | /*?page |
Disallow | /a/ |
Disallow | /stat/ |
Disallow | /index/1 |
Disallow | /index/3 |
Disallow | /index/5 |
Disallow | /index/7 |
Disallow | /index/8 |
Disallow | /index/9 |
Disallow | /register |
Disallow | /confirm/ |
Disallow | /index/sub/ |
Disallow | /panel/ |
Disallow | /admin/ |
Disallow | /informer/ |
Disallow | /secure/ |
Disallow | /poll/ |
Disallow | /search/ |
Disallow | /bibliotheca/search.html |
Disallow | /edu/search.html |
Disallow | /video/chu |
Disallow | /video/cha |
Disallow | /mchat |
Disallow | /abnl/ |
Disallow | /*_escaped_fragment_%3D |
Disallow | /*-*-*-*-987$ |
Disallow | /?ssid= |
Disallow | /*-0-0- |
Disallow | /*0-*-0-17$ |
Disallow | /js/ |
Disallow | /*? |
Disallow | /rtr/ |
Disallow | /*-$ |
Disallow | /*%26* |
Other Records
Field | Value |
---|---|
sitemap | https://colovrat.org/sitemap.xml |
sitemap | https://colovrat.org/bibliotheca.xml |
sitemap | https://colovrat.org/edu.xml |
Warnings
- `host` is not a known field.