brestcity.com
robots.txt
Robots Exclusion Standard data for brestcity.com
Resource Scan
Scan Details
| Site Domain | brestcity.com |
| Base Domain | brestcity.com |
| Scan Status | Ok |
| Last Scan | 2024-06-02T16:04:08+00:00 |
| Next Scan | 2024-07-02T16:04:08+00:00 |
Last Scan
| Scanned | 2024-06-02T16:04:08+00:00 |
| URL | https://brestcity.com/robots.txt |
| Domain IPs | 178.172.138.3 |
| Response IP | 178.172.138.3 |
| Found | Yes |
| Hash | d1fd6b53c55b5e0ade7497691cfcd7f7ba7af223b2c22b1acb1c7962e026c670 |
| SimHash | c54582701738 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | êëàññèêà... |
| Disallow | /doc/* | - |
| Disallow | /? | âñå ïàðàìåòðû çàïðîñà íà ãëàâíîé |
| Disallow | /*?* | - |
| Disallow | /wp- | âñå ôàéëû WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | ïîèñê |
| Disallow | *%26s%3D | ïîèñê |
| Disallow | /search | ïîèñê |
| Disallow | /author/ | àðõèâ àâòîðà |
| Disallow | *?attachment_id= | ñòðàíèöà âëîæåíèÿ. Âîîáùå-òî íà íåé ðåäèðåêò... |
| Disallow | */embed | âñå âñòðàèâàíèÿ |
| Disallow | */page/ | âñå âèäû ïàãèíàöèè |
| Disallow | */uploads | îòêðûâàåì uploads |
| Allow | */feed/pulse/ | - |
| Allow | /*/*.js | âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà) |
| Allow | /*/*.css | âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà) |
| Disallow | */wp-*.png | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.jpg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.jpeg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.gif | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.svg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.pdf | ôàéëû â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | /2009/* | - |
| Disallow | /2010/* | - |
| Disallow | /2011/* | - |
| Disallow | /2012/* | - |
| Disallow | /2013/* | - |
| Disallow | /2014/* | - |
| Disallow | /2015/* | - |
| Disallow | /2016/* | - |
| Disallow | /2017/* | - |
| Disallow | /2018/* | - |
| Disallow | */comment-image/* | - |
| Disallow | *?paged* | - |
| Disallow | /go1.php | - |
| Disallow | /go2.php | - |
| Disallow | /go3.php | - |
| Disallow | /go4.php | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
yandex
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | êëàññèêà... |
| Disallow | /doc/* | - |
| Disallow | /? | âñå ïàðàìåòðû çàïðîñà íà ãëàâíîé |
| Disallow | /*?* | - |
| Disallow | */wp- | âñå ôàéëû WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | ïîèñê |
| Disallow | *%26s%3D | ïîèñê |
| Disallow | /search | ïîèñê |
| Disallow | /author/ | àðõèâ àâòîðà |
| Disallow | *?attachment_id= | ñòðàíèöà âëîæåíèÿ. Âîîáùå-òî íà íåé ðåäèðåêò... |
| Disallow | */rss | rss ôèä |
| Disallow | */embed | âñå âñòðàèâàíèÿ |
| Disallow | */page/ | âñå âèäû ïàãèíàöèè |
| Disallow | */uploads | îòêðûâàåì uploads |
| Allow | /*/*.js | âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà) |
| Allow | /*/*.css | âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà) |
| Disallow | */wp-*.png | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.jpg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.jpeg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.gif | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.svg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.pdf | ôàéëû â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | /2012/* | - |
| Disallow | /2013/* | - |
| Disallow | /2014/* | - |
| Disallow | /2015/* | - |
| Disallow | /2016/* | - |
| Disallow | /2017/* | - |
| Disallow | /2018/* | - |
| Disallow | */comment-image/* | - |
| Disallow | /*amp | - |
| Disallow | *?paged* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | êëàññèêà... |
| Disallow | /doc/* | - |
| Disallow | /? | âñå ïàðàìåòðû çàïðîñà íà ãëàâíîé |
| Disallow | /*?* | - |
| Disallow | */wp- | âñå ôàéëû WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | *?s= | ïîèñê |
| Disallow | *%26s%3D | ïîèñê |
| Disallow | /search | ïîèñê |
| Disallow | /author/ | àðõèâ àâòîðà |
| Disallow | *?attachment_id= | ñòðàíèöà âëîæåíèÿ. Âîîáùå-òî íà íåé ðåäèðåêò... |
| Disallow | */feed | âñå ôèäû |
| Disallow | */rss | rss ôèä |
| Disallow | */embed | âñå âñòðàèâàíèÿ |
| Disallow | */page/ | âñå âèäû ïàãèíàöèè |
| Disallow | */uploads | îòêðûâàåì uploads |
| Allow | /*/*.js | âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà) |
| Allow | /*/*.css | âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà) |
| Disallow | */wp-*.png | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.jpg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.jpeg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.gif | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.svg | êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | */wp-*.pdf | ôàéëû â ïëàãèíàõ, cache ïàïêå è ò.ä. |
| Disallow | /2012/* | - |
| Disallow | /2013/* | - |
| Disallow | /2014/* | - |
| Disallow | /2015/* | - |
| Disallow | /2016/* | - |
| Disallow | */comment-image/* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://brestcity.com/blog/sitemap_index.xml |
Warnings
- `host` is not a known field.