ixbt.com
robots.txt
Robots Exclusion Standard data for ixbt.com
Resource Scan
Scan Details
| Site Domain | ixbt.com |
| Base Domain | ixbt.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T22:50:31+00:00 |
| Next Scan | 2024-11-04T22:50:31+00:00 |
Last Scan
| Scanned | 2024-10-28T22:50:31+00:00 |
| URL | https://ixbt.com/robots.txt |
| Domain IPs | 91.208.42.67 |
| Response IP | 91.208.42.67 |
| Found | Yes |
| Hash | 27b35a156f70180e23cf2c3ac2a7f1d8c22bb951f47cffa504728f32b1f7815e |
| SimHash | ed63e47fc611 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /live/*/*.html |
| Allow | /live/blog/ |
| Disallow | /live/talk/ |
| Disallow | /click/ |
| Disallow | /live/*/new/ |
| Disallow | /live/*/discussed/ |
| Disallow | /live/*/top/ |
| Disallow | /live/*/feed/ |
| Disallow | /live/*/users/ |
| Disallow | /live/stream/ |
| Disallow | /live/profile |
| Disallow | /live/personal |
| Disallow | /live/rss |
| Disallow | /live/custom |
| Disallow | /live/tag |
| Disallow | /live/comments |
| Disallow | /live/blog/*.html |
| Disallow | /live/personal_blog |
| Disallow | /live/*/?period= |
| Disallow | /live/comments |
| Disallow | /live/companies |
| Disallow | /advertising/ |
| Disallow | /news/search/ |
| Disallow | /cgi-bin/ |
| Disallow | /m/ |
| Disallow | /ftp/ |
| Disallow | /include/ |
| Disallow | /include2/ |
| Disallow | /reklama.shtml |
| Disallow | /export.shtml |
| Disallow | /about.shtml |
| Disallow | /tag/ |
| Disallow | /news/index/*/*/ |
| Disallow | /cgi/ |
| Disallow | /news/*.php |
| Disallow | /pda/pda-describ/*/*/ |
| Disallow | /*.pl |
| Disallow | /*/context_block.html |
| Disallow | /admin/ |
| Disallow | /staticnews/ |
| Disallow | /testarea/ |
| Disallow | /tmp/ |
| Disallow | /mobile/phonemodel/ |
| Disallow | /export/handy/ |
| Disallow | /blogs-lsrc/ |
| Disallow | /*?show=tape |
| Disallow | /arts-test/ |
| Disallow | /__ |
| Disallow | /_include/index/ |
| Disallow | *?filter_text=* |
| Disallow | *?brand=* |
| Disallow | /adv/ |
| Disallow | /test |
yandex
| Rule | Path |
|---|---|
| Allow | /live/*/*.html |
| Allow | /live/blog/ |
| Allow | /*/?page= |
| Disallow | /live/talk/ |
| Disallow | /click/ |
| Disallow | /live/comments |
| Disallow | /live*?order |
| Disallow | /live/profile |
| Disallow | /live/rss |
| Disallow | /live/tag |
| Disallow | /live/personal |
| Disallow | /live/companies |
| Disallow | /live/custom |
| Disallow | /live/comments |
| Disallow | /live/*/?period= |
| Disallow | /live/index/ |
| Disallow | /live/*/new/ |
| Disallow | /live/*/discussed/ |
| Disallow | /live/*/top/ |
| Disallow | /live/*/feed/ |
| Disallow | /live/stream/ |
| Disallow | /live/*/users/ |
| Disallow | /live/blog/*.html |
| Disallow | /live/custom |
| Disallow | /live/personal_blog |
| Disallow | /video3/images/ |
| Disallow | /video4/images/ |
| Disallow | /reklama.shtml |
| Disallow | /export.shtml |
| Disallow | /about.shtml |
| Disallow | /tag/ |
| Disallow | /news/search/ |
| Disallow | /cgi-bin/ |
| Disallow | /m/ |
| Disallow | /*.xls |
| Disallow | /*.xlsx |
| Disallow | /*.exe |
| Disallow | /ftp/ |
| Disallow | /include/ |
| Disallow | /include2/ |
| Disallow | /news/index/*/*/ |
| Disallow | /cgi/ |
| Disallow | /news/*.php |
| Disallow | /*.pl |
| Disallow | /pda/pda-describ/*/*/ |
| Disallow | /*/context_block.html |
| Disallow | /admin/ |
| Disallow | /staticnews/ |
| Disallow | /testarea/ |
| Disallow | /tmp/ |
| Disallow | /mobile/phonemodel/ |
| Disallow | /export/handy/ |
| Disallow | /arts-test/ |
| Disallow | /news/soft/ |
| Disallow | /news/hard/ |
| Disallow | /video/itogi-video/ |
| Disallow | /__ |
| Disallow | /_include/index/ |
| Disallow | /? |
| Disallow | /advertising/ |
| Disallow | /adv/ |
| Disallow | /test |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ixbt.com/export/sitemapindex_https.xml |
| sitemap | https://www.ixbt.com/live/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.