laptopprocessors.ru
robots.txt
Robots Exclusion Standard data for laptopprocessors.ru
Resource Scan
Scan Details
| Site Domain | laptopprocessors.ru |
| Base Domain | laptopprocessors.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-16T08:09:47+00:00 |
| Next Scan | 2024-10-16T08:09:47+00:00 |
Last Scan
| Scanned | 2024-09-16T08:09:47+00:00 |
| URL | https://laptopprocessors.ru/robots.txt |
| Redirect | https://business-programming.ru/robots.txt |
| Redirect Domain | business-programming.ru |
| Redirect Base | business-programming.ru |
| Domain IPs | 86.110.220.147 |
| Redirect IPs | 86.110.220.147 |
| Response IP | 86.110.220.147 |
| Found | Yes |
| Hash | 7fabaf0675b52c75e0485e25c22de9616a67fe85d0f3e6211466b7b048d114c0 |
| SimHash | 6da9fee24b38 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | - |
| Disallow | /wp-login.php | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-includes/ | - |
| Disallow | /wp-content/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /wp-content/themes/ | - |
| Disallow | /?author=* | - |
| Disallow | /cgi-bin | классика... |
| Disallow | /? | все параметры запроса на главной |
| Disallow | *?s= | поиск |
| Disallow | /?s= | - |
| Disallow | /?p= | - |
| Disallow | *%26s%3D | поиск |
| Disallow | /search | поиск |
| Disallow | /author/ | архив автора |
| Disallow | */20 | все архивы |
| Disallow | */tag | все теги |
| Disallow | *?attachment_id= | страница вложения. Вообще-то на ней редирект... |
| Disallow | /trackback | - |
| Disallow | */trackback | - |
| Disallow | */*/trackback | - |
| Disallow | /attachment/ | - |
| Disallow | */feed | - |
| Disallow | */*/feed/*/ | - |
| Disallow | /product-tag/ | теги продуктов |
| Disallow | /cart/ | - |
| Disallow | /category/ | - |
| Disallow | /checkout/ | - |
| Disallow | /my-account/ | - |
| Disallow | /*openstat | - |
| Disallow | /*utm%3D | - |
| Disallow | *?orderby= | - |
| Disallow | /include/ | - |
| Disallow | */embed | все встраивания |
| Disallow | */page/ | все виды пагинации |
| Disallow | /recent-videos | последние видео |
| Disallow | /video-of-the-day | видео за день |
| Disallow | /video-of-the-week | видео за неделю |
| Disallow | /video-of-the-month | видео за месяц |
| Disallow | /all-the-time | видео за все время |
| Disallow | /i | - |
| Disallow | /?blackhole | - |
| Disallow | /wp-content/languages/ | - |
| Allow | */uploads | внутри /wp- |
| Allow | /*/*.js | внутри /wp- (/*/ - для приоритета) |
| Allow | /*/*.css | внутри /wp- (/*/ - для приоритета) |
| Allow | /wp-*.png | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.jpg | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.jpeg | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.gif | картинки в плагинах, cache папке и т.д. |
| Allow | /feed/turbo/ | турбо страница |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 2 | таймаут в сек |
Other Records
| Field | Value |
|---|---|
| sitemap | https://laptopprocessors.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments