svetlica-mama-blogger.ru
robots.txt

Robots Exclusion Standard data for svetlica-mama-blogger.ru

Resource Scan

Scan Details

Site Domain svetlica-mama-blogger.ru
Base Domain svetlica-mama-blogger.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T21:19:02+00:00
Next Scan 2024-07-07T21:19:02+00:00

Last Successful Scan

Scanned2022-06-22T03:24:10+00:00
URL https://svetlica-mama-blogger.ru/robots.txt
Response IP 5.23.50.132
Found Yes
Hash ecf3dd2744494d5582fcfec3db8ffe49ebfc8ae40bdbbb47f1da828c3b68d7b8
SimHash 4b1013327b15

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-includes/js
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-comments
Disallow /author/
Disallow */trackback
Disallow */comments
Disallow /*.pdf
Disallow /*.pdf$
Disallow /wp-content/uploads/*/*.pdf
Disallow /wp-json/

ahrefsbot/5.1

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

dotbot/1.2

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /feed/turbo

yandeximages

Rule Path
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-includes/js
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-comments
Disallow /author/
Disallow */trackback
Disallow */comments
Disallow /*.pdf
Disallow /*.pdf$
Disallow /wp-content/uploads/*/*.pdf
Disallow /wp-json/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /feed/turbo

Other Records

Field Value
sitemap https://svetlica-mama-blogger.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.