skachaj24.ru
robots.txt

Robots Exclusion Standard data for skachaj24.ru

Resource Scan

Scan Details

Site Domain skachaj24.ru
Base Domain skachaj24.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-18T18:59:56+00:00
Next Scan 2024-12-17T18:59:56+00:00

Last Successful Scan

Scanned2022-05-01T01:44:23+00:00
URL https://skachaj24.ru/robots.txt
Response IP 87.236.16.229
Found Yes
Hash 987b9d00d0a7418d8d2b9514bb5437b52f98d87c4ccf9a8f7aa3d607c2eb33e2
SimHash 645cd95104f8

Groups

*

Rule Path
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */page/
Disallow /page/*/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow /cache
Disallow /category/*/
Disallow /maxsite-cache-key.php
Disallow /maxsite-cache-no-cache.php
Disallow /maxsite-cache-plugin.php
Disallow /maxsite-cache-statistic.txt
Disallow /maxsite-cache-vars.php
Disallow /maxsite-cache.php
Disallow *utm%3D
Disallow *openstat%3D
Allow */uploads

Other Records

Field Value
crawl-delay 120

googlebot

Rule Path
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */page/
Disallow /page/*/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow /cache
Disallow /category/*/
Disallow /maxsite-cache-key.php
Disallow /maxsite-cache-no-cache.php
Disallow /maxsite-cache-plugin.php
Disallow /maxsite-cache-statistic.txt
Disallow /maxsite-cache-vars.php
Disallow /maxsite-cache.php
Disallow *utm%3D
Disallow *openstat%3D
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */page/
Disallow /page/*
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow /cache/
Disallow /category/*
Disallow /maxsite-cache-key.php
Disallow /maxsite-cache-no-cache.php
Disallow /maxsite-cache-plugin.php
Disallow /maxsite-cache-statistic.txt
Disallow /maxsite-cache-vars.php
Disallow /maxsite-cache.php
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexaccessibilitybot

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

odklbot

Rule Path
Disallow /

openstat.ru/bot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

vkshare

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://skachaj24.ru/sitemap.xml
sitemap https://skachaj24.ru/sitemap.xml.gz

Warnings

  • `host` is not a known field.