spress.cc
robots.txt
Robots Exclusion Standard data for spress.cc
Resource Scan
Scan Details
| Site Domain | spress.cc |
| Base Domain | spress.cc |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-08-18T08:45:51+00:00 |
| Next Scan | 2024-11-16T08:45:51+00:00 |
Last Successful Scan
| Scanned | 2024-01-22T04:11:55+00:00 |
| URL | https://spress.cc/robots.txt |
| Domain IPs | 104.21.28.161, 172.67.170.237, 2606:4700:3034::6815:1ca1, 2606:4700:3035::ac43:aaed |
| Response IP | 104.21.28.161 |
| Found | Yes |
| Hash | 12342c1a60e3ba731362c97a51f813deac4d5bc9fa585ae6d1add1c2858c6b5a |
| SimHash | 6e395462c544 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /?feed_action=zen |
| Allow | /?feed_action=yandex-turbo |
| Allow | /wp-content/uploads |
| Allow | /files/articles/ |
| Allow | /files/old/ |
| Allow | /files/photos/ |
| Allow | /userfiles/images/ |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /*trackback |
| Disallow | /*.html/$ |
| Disallow | /*openstat* |
| Disallow | /*?utm* |
| Disallow | /*%26utm* |
| Disallow | /*?from* |
| Disallow | /*%26from* |
| Disallow | /*gclid* |
| Disallow | /*yclid* |
| Disallow | /*ymclid* |
| Disallow | /*?tid* |
| Disallow | /*%26tid* |
| Disallow | /?s=* |
| Disallow | /*?post |
| Disallow | /*p%3D |
| Disallow | /*bin.aspx |
| Disallow | /*orig_*/ |
| Disallow | /*labelDate%3D |
| Disallow | /*year%3D |
| Disallow | /*month%3D |
| Disallow | /*day%3D |
| Disallow | /wp-json/ |
| Disallow | /*/undefined/ |
| Disallow | /*?doing_wp_cron= |
| Disallow | /*?mode |
| Disallow | /*?order |
| Disallow | /*?amp |
| Disallow | /*attachment |
| Disallow | /*?sa |
| Disallow | /*preview |
| Disallow | /*?es= |
| Disallow | /*?pagenum |
| Disallow | /*?$ |
| Disallow | /*?mode |
| Disallow | /article/*/feed |
| Disallow | /*?show |
| Disallow | /*/amp/ |
| Disallow | /page/ |
| Disallow | /*?oprd |
| Disallow | /*?sendputm_sourceulse |
| Disallow | /tag/*/feed/ |
| Disallow | /bin.php |
| Disallow | /*uniq_float |
| Disallow | /*?google_editors_picks |
| Disallow | /*?t |
| Disallow | /*?u |
| Disallow | /*?version |
| Disallow | /*?at |
| Disallow | /*?fb |
| Disallow | /*?request |
| Disallow | /*action%3Dresult |
| Disallow | /*?ann |
| Disallow | /image_sharing/ |
| Disallow | /*?title |
| Disallow | /*?p_id |
| Disallow | /*?platform |
| Disallow | /*?osm |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads |
| Allow | /files/articles/ |
| Allow | /files/old/ |
| Allow | /files/photos/ |
| Allow | /userfiles/images/ |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /*trackback |
| Disallow | /*.html/$ |
| Disallow | /*openstat* |
| Disallow | /*?utm* |
| Disallow | /*%26utm* |
| Disallow | /*?from* |
| Disallow | /*%26from* |
| Disallow | /*gclid* |
| Disallow | /*yclid* |
| Disallow | /*ymclid* |
| Disallow | /*?tid* |
| Disallow | /*%26tid* |
| Disallow | /?s=* |
| Disallow | /*?post |
| Disallow | /*p%3D |
| Disallow | /*bin.aspx |
| Disallow | /*orig_*/ |
| Disallow | /*labelDate%3D |
| Disallow | /*year%3D |
| Disallow | /*month%3D |
| Disallow | /*day%3D |
| Disallow | /wp-json/ |
| Disallow | /*/undefined/ |
| Disallow | /*?doing_wp_cron= |
| Disallow | /*?mode |
| Disallow | /*?order |
| Disallow | /*?amp |
| Disallow | /*attachment |
| Disallow | /*?sa |
| Disallow | /*preview |
| Disallow | /*?es= |
| Disallow | /*?pagenum |
| Disallow | /*?$ |
| Disallow | /*?mode |
| Disallow | /article/*/feed |
| Disallow | /*?show |
| Disallow | /page/ |
| Disallow | /*?oprd |
| Disallow | /*?sendputm_sourceulse |
| Disallow | /tag/*/feed/ |
| Disallow | /bin.php |
| Disallow | /*uniq_float |
| Disallow | /*?google_editors_picks |
| Disallow | /*?t |
| Disallow | /*?u |
| Disallow | /*?version |
| Disallow | /*?at |
| Disallow | /*?fb |
| Disallow | /*?request |
| Disallow | /*action%3D |
| Disallow | /*?ann |
| Disallow | /image_sharing/ |
| Disallow | /*?title |
| Disallow | /*?p_id |
| Disallow | /*?platform |
| Disallow | /*?osm |
Other Records
| Field | Value |
|---|---|
| sitemap | https://spektr.press/sitemap_index.xml |
Warnings
- `host` is not a known field.