megacritic.ru
robots.txt
Robots Exclusion Standard data for megacritic.ru
Resource Scan
Scan Details
| Site Domain | megacritic.ru |
| Base Domain | megacritic.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-19T15:06:43+00:00 |
| Next Scan | 2024-09-26T15:06:43+00:00 |
Last Scan
| Scanned | 2024-09-19T15:06:43+00:00 |
| URL | https://megacritic.ru/robots.txt |
| Domain IPs | 104.21.81.176, 172.67.145.136, 2606:4700:3030::ac43:9188, 2606:4700:3035::6815:51b0 |
| Response IP | 104.21.81.176 |
| Found | Yes |
| Hash | 5bcd05707e91920461795da2577775ce7f12e5ef9295e143c932e1a3cd718b68 |
| SimHash | cb1c01c14073 |
Groups
yandexbot
| Rule | Path |
|---|---|
| Disallow | *? |
| Disallow | /*? |
| Allow | /*?page |
| Allow | /*favicon.ico |
| Allow | /*fonts/ |
| Disallow | /administrator/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Allow | /cache/plg_jch_optimize/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Allow | /components/com_jreviews/jreviews/views/js/ |
| Allow | /components/com_jreviews/jreviews/views/themes/default/theme_css/ |
| Allow | /components/com_s2framework/tmp |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /layouts/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /speller |
| Disallow | /tmp/ |
| Allow | /templates/*.css |
| Allow | /templates/*.js |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /media/*.js |
| Allow | /media/*.css |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Disallow | /index.php |
| Allow | /index.php?option=com_jreviews&format=raw&tmpl=component |
| Disallow | /arhiv/ |
| Disallow | /*Itemid%3D |
| Disallow | /*start%3D |
| Disallow | /*order%3D |
| Disallow | /*extension%3D |
| Disallow | /*option%3D |
| Disallow | /*review |
| Allow | /*jreviews_overrides/ |
| Allow | /*media/reviews/ |
| Disallow | /*search |
| Disallow | /*poisk-filmov/search-results |
| Disallow | /*poisk-filmov/tag |
| Disallow | /*component |
| Disallow | /*criteria |
| Disallow | /*content |
| Allow | /*wp-content |
| Disallow | /*compare |
| Allow | /*js/jreviews.compare |
| Disallow | /*discussions |
| Disallow | /top/page |
| Disallow | /top/wp-admin |
| Disallow | /top/wp-includes |
| Disallow | /top/wp-content/cache |
| Allow | /top/wp-content/cache/wpo-minify/ |
| Disallow | /top/wp-json/ |
| Disallow | /top/xmlrpc.php |
| Disallow | /top/readme.html |
| Disallow | /top/*? |
| Disallow | /top/?s= |
| Allow | /top/wp-includes/*.css |
| Allow | /top/wp-includes/*.js |
| Allow | /top/wp-content/*.css |
| Allow | /top/wp-content/*.js |
| Allow | /top/*.css |
| Allow | /top/*.js |
googlebot
| Rule | Path |
|---|---|
| Disallow | *? |
| Disallow | /*? |
| Allow | /*?page |
| Allow | /*favicon.ico |
| Allow | /*fonts/ |
| Disallow | /administrator/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Disallow | /logs/ |
| Disallow | /speller |
| Disallow | /tmp/ |
| Allow | /templates/*.css |
| Allow | /templates/*.js |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /media/*.js |
| Allow | /media/*.css |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Allow | /index.php?option=com_jreviews&format=raw&tmpl=component |
| Allow | /*jreviews_overrides/ |
| Allow | /*media/reviews |
| Disallow | /top/page |
| Disallow | /top/wp-admin |
| Disallow | /top/wp-includes |
| Disallow | /top/wp-content/cache |
| Allow | /top/wp-content/cache/wpo-minify/ |
| Disallow | /top/wp-json/ |
| Disallow | /top/xmlrpc.php |
| Disallow | /top/readme.html |
| Disallow | /top/*? |
| Disallow | /top/?s= |
| Allow | /top/wp-includes/*.css |
| Allow | /top/wp-includes/*.js |
| Allow | /top/wp-content/*.css |
| Allow | /top/wp-content/*.js |
| Allow | /top/*.css |
| Allow | /top/*.js |
*
| Rule | Path |
|---|---|
| Disallow | *? |
| Disallow | /*? |
| Allow | /*favicon.ico |
| Disallow | /administrator/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Allow | /cache/plg_jch_optimize/ |
| Disallow | /cli/ |
| Disallow | /components/ |
| Allow | /components/com_jreviews/jreviews/views/js/ |
| Allow | /components/com_jreviews/jreviews/views/themes/default/theme_css/ |
| Allow | /components/com_s2framework/tmp |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /layouts/ |
| Disallow | /libraries/ |
| Disallow | /logs/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /tmp/ |
| Allow | /templates/*.css |
| Allow | /templates/*.js |
| Allow | /components/*.css |
| Allow | /components/*.js |
| Allow | /media/*.js |
| Allow | /media/*.css |
| Allow | /plugins/*.css |
| Allow | /plugins/*.js |
| Disallow | /index.php |
| Allow | /index.php?option=com_jreviews&format=raw&tmpl=component |
| Disallow | /arhiv/ |
| Disallow | /*Itemid%3D |
| Disallow | /*start%3D |
| Disallow | /*order%3D |
| Disallow | /*extension%3D |
| Disallow | /*option%3D |
| Disallow | /*review |
| Allow | /*jreviews_overrides/ |
| Allow | /*media/reviews/ |
| Disallow | /*search |
| Disallow | /*poisk-filmov/search-results |
| Disallow | /*poisk-filmov/tag |
| Disallow | /*component |
| Disallow | /*criteria |
| Disallow | /*content |
| Allow | /*wp-content |
| Disallow | /*compare |
| Allow | /*js/jreviews.compare |
| Disallow | /*discussions |
| Disallow | /top/page |
| Disallow | /top/wp-admin |
| Disallow | /top/wp-includes |
| Disallow | /top/wp-content/cache |
| Allow | /top/wp-content/cache/wpo-minify/ |
| Disallow | /top/wp-json/ |
| Disallow | /top/xmlrpc.php |
| Disallow | /top/readme.html |
| Disallow | /top/*? |
| Disallow | /top/?s= |
| Allow | /top/wp-includes/*.css |
| Allow | /top/wp-includes/*.js |
| Allow | /top/wp-content/*.css |
| Allow | /top/wp-content/*.js |
| Allow | /top/*.css |
| Allow | /top/*.js |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.megacritic.ru/sitemap/xml |
| sitemap | https://www.megacritic.ru/top/sitemap_index.xml |