gbustkr.ru
robots.txt
Robots Exclusion Standard data for gbustkr.ru
Resource Scan
Scan Details
| Site Domain | gbustkr.ru |
| Base Domain | gbustkr.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-22T20:03:04+00:00 |
| Next Scan | 2024-11-20T20:03:04+00:00 |
Last Successful Scan
| Scanned | 2024-04-25T20:01:20+00:00 |
| URL | https://gbustkr.ru/robots.txt |
| Domain IPs | 2a00:f940:2:2:1:1:0:166, 31.31.196.204 |
| Response IP | 31.31.196.204 |
| Found | Yes |
| Hash | 69eb0f3d45912cda0dcdde1b868b957bd952a08687388a4639bd125c1116c06f |
| SimHash | 603880d18d35 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /info/cgi-bin | клаÑÑика... |
| Disallow | /info/? | вÑе паÑамеÑÑÑ Ð·Ð°Ð¿ÑоÑа на главной |
| Disallow | /info/wp- | вÑе ÑÐ°Ð¹Ð»Ñ WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | поиÑк |
| Disallow | *%26s%3D | поиÑк |
| Disallow | /info/search | поиÑк |
| Disallow | /info/author/ | аÑÑ |
| Disallow | */embed | вÑе вÑÑÑÐ°Ð¸Ð²Ð°Ð½Ð¸Ñ |
| Disallow | */page/ | вÑе Ð²Ð¸Ð´Ñ Ð¿Ð°Ð³Ð¸Ð½Ð°Ñии |
| Allow | */uploads | оÑкÑÑваем uploads |
| Allow | /info/*/*.js | внÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
| Allow | /info/*/*.css | внÑÑÑи /wp- (/*/ - Ð´Ð»Ñ Ð¿ÑиоÑиÑеÑа) |
| Allow | /info/wp-*.png | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /info/wp-*.jpg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /info/wp-*.jpeg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /info/wp-*.gif | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /info/wp-*.svg | каÑÑинки в Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /info/wp-*.pdf | ÑÐ°Ð¹Ð»Ñ Ð² Ð¿Ð»Ð°Ð³Ð¸Ð½Ð°Ñ |
| Allow | /info/wp-admin/admin-ajax.php | - |
*
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 40 | Ð·Ð°Ð´Ð°ÐµÑ ÑаймаÑÑ Ð² 40 ÑекÑнд Ð´Ð»Ñ Ð²ÑÐµÑ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gbustkr.ru/info/sitemap.xml |
Warnings
- 9 invalid lines.
Comments