Log In Sign Up

mosregion.info
robots.txt

Robots Exclusion Standard data for mosregion.info

Resource Scan

Scan Details

Site Domain mosregion.info
Base Domain mosregion.info
Scan Status Ok
Last Scan2024-11-11T10:16:33+00:00
Next Scan 2024-11-18T10:16:33+00:00

Last Scan

Scanned2024-11-11T10:16:33+00:00
URL https://mosregion.info/robots.txt
Redirect https://www.mosregion.info/robots.txt
Redirect Domain www.mosregion.info
Redirect Base mosregion.info
Domain IPs 104.21.30.34, 172.67.150.119, 2606:4700:3030::6815:1e22, 2606:4700:3030::ac43:9677
Redirect IPs 104.21.30.34, 172.67.150.119, 2606:4700:3030::6815:1e22, 2606:4700:3030::ac43:9677
Response IP 172.67.150.119
Found Yes
Hash d428a7d7bdb2da1a1ab7399c3a59326de2a1821de35b273e6a6db8ae2e76715a
SimHash 5a40dc628ab3

Groups

yandex

Rule Path
Allow *?yandex_feed=news
Disallow /category/*/page/
Disallow /page/*
Disallow /news/*
Disallow *?s=
Disallow /wp-admin/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /wp-includes/
Disallow /*.jpeg
Disallow /*.jpg
Disallow /*.gif
Disallow /*.png

*

Rule Path
Disallow /category/*/page/
Disallow /page/*
Disallow /news/*
Disallow /feed/
Disallow *?s=
Disallow /wp-admin/
Disallow /wp-json/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php

yandex

Rule Path
Disallow /wp-content/uploads/

yandexnews

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.mosregion.info/sitemap_index.xml
Back to top

Comments

  • Disallow: /*.jpeg
  • Disallow: /*.jpg
  • Disallow: /*.gif
  • Disallow: /*.png
Back to top

Warnings

  • 2 invalid lines.
  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top