Log In Sign Up

ladys.media
robots.txt

Robots Exclusion Standard data for ladys.media

Resource Scan

Scan Details

Site Domain ladys.media
Base Domain ladys.media
Scan Status Ok
Last Scan2024-11-13T14:52:58+00:00
Next Scan 2024-11-20T14:52:58+00:00

Last Scan

Scanned2024-11-13T14:52:58+00:00
URL https://ladys.media/robots.txt
Redirect https://www.ladys.media/robots.txt
Redirect Domain www.ladys.media
Redirect Base ladys.media
Domain IPs 104.26.10.79, 104.26.11.79, 172.67.75.116, 2606:4700:20::681a:a4f, 2606:4700:20::681a:b4f, 2606:4700:20::ac43:4b74
Redirect IPs 104.26.10.79, 104.26.11.79, 172.67.75.116, 2606:4700:20::681a:a4f, 2606:4700:20::681a:b4f, 2606:4700:20::ac43:4b74
Response IP 104.26.10.79
Found Yes
Hash e7ffe9a3682ef87ca15618dcd6a6681f662683065e734507a4b9130887ee829b
SimHash 6a40cc6283b3

Groups

yandex

Rule Path
Allow *?yandex_feed=news
Disallow /category/*/page/
Disallow /page/*
Disallow /news/*
Disallow *?s=
Disallow /wp-admin/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /wp-includes/
Disallow /*.jpeg
Disallow /*.jpg
Disallow /*.gif
Disallow /*.png

*

Rule Path
Disallow /category/*/page/
Disallow /page/*
Disallow /news/*
Disallow *?s=
Disallow /wp-admin/
Disallow /wp-json/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php

yandex

Rule Path
Disallow /wp-content/uploads/

yandexnews

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.ladys.media/sitemap_index.xml
Back to top

Comments

  • Disallow: /*.jpeg
  • Disallow: /*.jpg
  • Disallow: /*.gif
  • Disallow: /*.png
  • User-agent: Googlebot-Image
  • Disallow: /
Back to top

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top