kolizeum.ru
robots.txt

Robots Exclusion Standard data for kolizeum.ru

Resource Scan

Scan Details

Site Domain kolizeum.ru
Base Domain kolizeum.ru
Scan Status Ok
Last Scan2024-04-27T07:28:39+00:00
Next Scan 2024-05-27T07:28:39+00:00

Last Scan

Scanned2024-04-27T07:28:39+00:00
URL https://kolizeum.ru/robots.txt
Domain IPs 87.236.16.238
Response IP 87.236.16.238
Found Yes
Hash ee516adaec7e1190b25022a5594b0dfbb657af86d427693651b5e65c88e70ec3
SimHash 4848940257bc

Groups

googlebot

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

yandex

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 10

Warnings

  • `host` is not a known field.