Log In Sign Up

day.ru
robots.txt

Robots Exclusion Standard data for day.ru

Resource Scan

Scan Details

Site Domain day.ru
Base Domain day.ru
Scan Status Ok
Last Scan2024-11-01T07:06:24+00:00
Next Scan 2024-11-08T07:06:24+00:00

Last Scan

Scanned2024-11-01T07:06:24+00:00
URL https://day.ru/robots.txt
Domain IPs 62.109.6.133
Response IP 62.109.6.133
Found Yes
Hash e491f5cca740d03a054b0a479ab3e6e5a419b1c90fc0d0abafe6c8678c10ffb3
SimHash 4d51c8001af3

Groups

yandex

Rule Path
Disallow /gsearch/
Disallow /article/*
Disallow /wp-json
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /cgi-bin
Disallow /*.pdf$
Disallow /*author-id%3D*
Disallow /*photo_id%3D*
Disallow */amp/
Disallow /author/*
Disallow /*?
Disallow /en/
Disallow /authors/*/page/
Disallow /tag/*/page/
Disallow /node/
Disallow */page/
Allow */page/2/

googlebot

Rule Path
Disallow /gsearch/
Disallow /article/*
Disallow /wp-admin
Disallow /wp-json
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /cgi-bin
Disallow /*.pdf$
Disallow /*author-id%3D*
Disallow /*photo_id%3D*
Disallow /*?
Disallow /en/
Disallow /authors/*/page/
Disallow /tag/*/page/
Disallow /node/
Disallow */page/
Allow */page/2/

*

Rule Path
Disallow /*?
Disallow /gsearch/
Disallow /article/*
Disallow /wp-admin
Disallow /wp-json
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-login.php
Disallow /cgi-bin
Disallow /*.pdf$
Disallow /*author-id%3D*
Disallow /*photo_id%3D*
Disallow /en/
Disallow /authors/*/page/
Disallow /tag/*/page/
Disallow /node/
Disallow */page/
Allow */page/2/

trendkite-akashic-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://day.ru/sitemap/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top