prorobot.ru
robots.txt
Robots Exclusion Standard data for prorobot.ru
Resource Scan
Scan Details
| Site Domain | prorobot.ru |
| Base Domain | prorobot.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-03T16:10:20+00:00 |
| Next Scan | 2024-10-10T16:10:20+00:00 |
Last Scan
| Scanned | 2024-10-03T16:10:20+00:00 |
| URL | https://prorobot.ru/robots.txt |
| Redirect | https://www.prorobot.ru/robots.txt |
| Redirect Domain | www.prorobot.ru |
| Redirect Base | prorobot.ru |
| Domain IPs | 217.29.63.146 |
| Redirect IPs | 217.29.63.146 |
| Response IP | 217.29.63.146 |
| Found | Yes |
| Hash | 472a6b14c023bfa5230e54a7f99c67e63bfe9e749bab8ac1ef6006535bd148bc |
| SimHash | e974cc028b2e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /robots_url.html |
| Disallow | /arduino/hexapod.php/hexapod/* |
| Disallow | /lego.php/load/ |
| Disallow | /lego.php/info/ |
| Disallow | /lego.php/lego/ |
| Disallow | /lego/dvijenie_po_spiraly.php/* |
| Disallow | /lego/robototehnika_v_shkole_6-8_klass.php/* |
| Disallow | /load/FILES/* |
| Disallow | /load/image/* |
| Disallow | /*hexapod/* |
| Disallow | /arduino/hexapod.php/hexapod/* |
| Disallow | /*?*utm_referrer* |
| Disallow | /guest/antispam.php |
| Disallow | /referats.php/ref |
| Disallow | /myrobotforum |
| Disallow | /m/ |
| Disallow | /mobile/ |
| Disallow | /gallery/index.php?add |
| Disallow | /gallery/flashupload/ |
| Disallow | /gallery/index.php?type |
| Disallow | /gallery/antispam.php |
| Disallow | /gallery/?addfoto |
| Disallow | /gallery/addmsg.php |
| Disallow | /05/ |
| Disallow | /slovarik.php?page=1 |
| Disallow | /golos/ |
| Disallow | /sendmail/ |
| Disallow | /counter/ |
| Disallow | /forum/?id= |
| Disallow | /forum/chat.php |
| Disallow | /forum/index.php?new |
| Disallow | /forum/tools.php |
| Disallow | /forum/index.php?fid |
| Disallow | /forum/antispam |
| Disallow | /forum/index.php?*&newtema=add* |
| Disallow | /forum/index.php?find |
| Disallow | /konkurs_risuem_robotov/ |
| Disallow | /404.php |
| Disallow | *.rbtx$ |
| Disallow | *.flv$ |
| Disallow | /top/wp-admin |
| Disallow | /top/wp-json/ |
| Disallow | /top/trackback |
| Disallow | /top/tag* |
| Disallow | /top/*page/* |
| Disallow | */attachment/* |
| Disallow | *?attachment_id= |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /top/?p=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.prorobot.ru/sitemap.xml |
| sitemap | https://www.prorobot.ru/forum/sitemap-wrforum.xml |
| sitemap | https://www.prorobot.ru/gallery/sitemap-wrfoto.xml |
| sitemap | https://www.prorobot.ru/top/sitemap_index.xml |
Warnings
- `host` is not a known field.