spektr.press
robots.txt
Robots Exclusion Standard data for spektr.press
Resource Scan
Scan Details
| Site Domain | spektr.press |
| Base Domain | spektr.press |
| Scan Status | Ok |
| Last Scan | 2024-11-08T22:09:26+00:00 |
| Next Scan | 2024-11-15T22:09:26+00:00 |
Last Scan
| Scanned | 2024-11-08T22:09:26+00:00 |
| URL | https://spektr.press/robots.txt |
| Domain IPs | 104.21.43.222, 172.67.186.182, 2606:4700:3036::ac43:bab6, 2606:4700:3037::6815:2bde |
| Response IP | 104.21.43.222 |
| Found | Yes |
| Hash | 12342c1a60e3ba731362c97a51f813deac4d5bc9fa585ae6d1add1c2858c6b5a |
| SimHash | 6e395462c544 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /?feed_action=zen |
| Allow | /?feed_action=yandex-turbo |
| Allow | /wp-content/uploads |
| Allow | /files/articles/ |
| Allow | /files/old/ |
| Allow | /files/photos/ |
| Allow | /userfiles/images/ |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /*trackback |
| Disallow | /*.html/$ |
| Disallow | /*openstat* |
| Disallow | /*?utm* |
| Disallow | /*%26utm* |
| Disallow | /*?from* |
| Disallow | /*%26from* |
| Disallow | /*gclid* |
| Disallow | /*yclid* |
| Disallow | /*ymclid* |
| Disallow | /*?tid* |
| Disallow | /*%26tid* |
| Disallow | /?s=* |
| Disallow | /*?post |
| Disallow | /*p%3D |
| Disallow | /*bin.aspx |
| Disallow | /*orig_*/ |
| Disallow | /*labelDate%3D |
| Disallow | /*year%3D |
| Disallow | /*month%3D |
| Disallow | /*day%3D |
| Disallow | /wp-json/ |
| Disallow | /*/undefined/ |
| Disallow | /*?doing_wp_cron= |
| Disallow | /*?mode |
| Disallow | /*?order |
| Disallow | /*?amp |
| Disallow | /*attachment |
| Disallow | /*?sa |
| Disallow | /*preview |
| Disallow | /*?es= |
| Disallow | /*?pagenum |
| Disallow | /*?$ |
| Disallow | /*?mode |
| Disallow | /article/*/feed |
| Disallow | /*?show |
| Disallow | /*/amp/ |
| Disallow | /page/ |
| Disallow | /*?oprd |
| Disallow | /*?sendputm_sourceulse |
| Disallow | /tag/*/feed/ |
| Disallow | /bin.php |
| Disallow | /*uniq_float |
| Disallow | /*?google_editors_picks |
| Disallow | /*?t |
| Disallow | /*?u |
| Disallow | /*?version |
| Disallow | /*?at |
| Disallow | /*?fb |
| Disallow | /*?request |
| Disallow | /*action%3Dresult |
| Disallow | /*?ann |
| Disallow | /image_sharing/ |
| Disallow | /*?title |
| Disallow | /*?p_id |
| Disallow | /*?platform |
| Disallow | /*?osm |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads |
| Allow | /files/articles/ |
| Allow | /files/old/ |
| Allow | /files/photos/ |
| Allow | /userfiles/images/ |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /*trackback |
| Disallow | /*.html/$ |
| Disallow | /*openstat* |
| Disallow | /*?utm* |
| Disallow | /*%26utm* |
| Disallow | /*?from* |
| Disallow | /*%26from* |
| Disallow | /*gclid* |
| Disallow | /*yclid* |
| Disallow | /*ymclid* |
| Disallow | /*?tid* |
| Disallow | /*%26tid* |
| Disallow | /?s=* |
| Disallow | /*?post |
| Disallow | /*p%3D |
| Disallow | /*bin.aspx |
| Disallow | /*orig_*/ |
| Disallow | /*labelDate%3D |
| Disallow | /*year%3D |
| Disallow | /*month%3D |
| Disallow | /*day%3D |
| Disallow | /wp-json/ |
| Disallow | /*/undefined/ |
| Disallow | /*?doing_wp_cron= |
| Disallow | /*?mode |
| Disallow | /*?order |
| Disallow | /*?amp |
| Disallow | /*attachment |
| Disallow | /*?sa |
| Disallow | /*preview |
| Disallow | /*?es= |
| Disallow | /*?pagenum |
| Disallow | /*?$ |
| Disallow | /*?mode |
| Disallow | /article/*/feed |
| Disallow | /*?show |
| Disallow | /page/ |
| Disallow | /*?oprd |
| Disallow | /*?sendputm_sourceulse |
| Disallow | /tag/*/feed/ |
| Disallow | /bin.php |
| Disallow | /*uniq_float |
| Disallow | /*?google_editors_picks |
| Disallow | /*?t |
| Disallow | /*?u |
| Disallow | /*?version |
| Disallow | /*?at |
| Disallow | /*?fb |
| Disallow | /*?request |
| Disallow | /*action%3D |
| Disallow | /*?ann |
| Disallow | /image_sharing/ |
| Disallow | /*?title |
| Disallow | /*?p_id |
| Disallow | /*?platform |
| Disallow | /*?osm |
Other Records
| Field | Value |
|---|---|
| sitemap | https://spektr.press/sitemap_index.xml |
Warnings
- `host` is not a known field.