jetbrains.com
robots.txt
Robots Exclusion Standard data for jetbrains.com
Resource Scan
Scan Details
| Site Domain | jetbrains.com |
| Base Domain | jetbrains.com |
| Scan Status | Ok |
| Last Scan | 2024-05-06T07:59:17+00:00 |
| Next Scan | 2024-05-20T07:59:17+00:00 |
Last Scan
| Scanned | 2024-05-06T07:59:17+00:00 |
| URL | https://jetbrains.com/robots.txt |
| Redirect | https://www.jetbrains.com/robots.txt |
| Redirect Domain | www.jetbrains.com |
| Redirect Base | jetbrains.com |
| Domain IPs | 108.157.254.126, 108.157.254.3, 108.157.254.46, 108.157.254.56 |
| Redirect IPs | 108.156.133.13, 108.156.133.59, 108.156.133.6, 108.156.133.65 |
| Response IP | 108.156.133.59 |
| Found | Yes |
| Hash | 0fa423e732ba562cbde7e6e94e359f15fa2f09418869fdbc02833c7b80126695 |
| SimHash | ac85d64c2d15 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */search/ |
| Disallow | */shop/ |
| Disallow | */eshop* |
| Disallow | */estore* |
| Disallow | */unitrun* |
| Disallow | /languages/ |
| Disallow | */feedback/ |
yandex
baidu
| Rule | Path |
|---|---|
| Disallow | */promo/ |
| Disallow | */download-thanks |
| Disallow | /?q |
| Disallow | /?products |
| Disallow | /?utm_source |
| Disallow | /?productedition |
| Disallow | /?src |
| Disallow | /?var |
| Disallow | /?type |
| Disallow | /?productversion |
| Disallow | /?order |
| Disallow | /?from |
| Disallow | /?search |
| Disallow | /?_ga |
| Disallow | /?_gac |
| Disallow | /?_gl |
| Disallow | /?edition |
| Disallow | /?utm_content |
| Disallow | /?vsversion |
| Disallow | /?hl |
| Disallow | /?u |
| Disallow | /?keyword |
| Disallow | /?utm_medium |
| Disallow | /?dclid |
| Disallow | /?topic |
| Disallow | /?rel |
| Disallow | /?source |
| Disallow | /?build |
| Disallow | /?platform |
| Disallow | /?ref |
| Disallow | /?installedvsversions |
| Disallow | /?utm_code |
| Disallow | /?fbclid |
| Disallow | /?products_id |
| Disallow | /?fromMenu |
| Disallow | /?fromFooter |
| Disallow | /?fromblog |
| Disallow | /?origin |
| Disallow | /?code |
| Disallow | /?fromide |
| Disallow | /?timezone |
| Disallow | /?utm_campaign |
| Disallow | /?gclsrc |
| Disallow | /?sid |
| Disallow | /?page |
| Disallow | /?section |
| Disallow | /?mkt_tok |
| Disallow | /?mode |
| Disallow | /?keymap |
| Disallow | /?rss |
| Disallow | /?s |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.jetbrains.com/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.
Comments