kirpikov.ru
robots.txt

Robots Exclusion Standard data for kirpikov.ru

Resource Scan

Scan Details

Site Domain kirpikov.ru
Base Domain kirpikov.ru
Scan Status Ok
Last Scan2025-09-25T11:41:10+00:00
Next Scan 2025-10-25T11:41:10+00:00

Last Scan

Scanned2025-09-25T11:41:10+00:00
URL https://kirpikov.ru/robots.txt
Domain IPs 87.236.16.241
Response IP 87.236.16.241
Found Yes
Hash 7ef380607ecd59b09181018aa4b1a385d9befa38c3a8abec61f450fef2fb08a0
SimHash 4848d40257fc

Groups

googlebot

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

yandex

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 10

Warnings

  • `host` is not a known field.