Log In Sign Up

sputnikmts.ru
robots.txt

Robots Exclusion Standard data for sputnikmts.ru

Resource Scan

Scan Details

Site Domain sputnikmts.ru
Base Domain sputnikmts.ru
Scan Status Ok
Last Scan2024-05-29T21:09:57+00:00
Next Scan 2024-06-05T21:09:57+00:00

Last Scan

Scanned2024-05-29T21:09:57+00:00
URL https://sputnikmts.ru/robots.txt
Redirect https://tarelka.pro/robots.txt
Redirect Domain tarelka.pro
Redirect Base tarelka.pro
Domain IPs 104.21.16.225, 172.67.216.69
Redirect IPs 80.87.97.190
Response IP 80.87.97.190
Found Yes
Hash 08aa12638b5464d0d64269c655af0d4b08f9a5534967ed61d95b991da53e6ad6
SimHash a6004a85f911

Groups

*

Rule Path
Disallow /wp-json
Disallow /wp-includes/wlwmanifest.xml
Disallow /?p=*
Disallow /?replytocom*
Disallow /?captcha*
Disallow /?trashed*

yandex

Rule Path
Disallow /*/amp/$
Disallow /wp-json
Disallow /wp-includes/wlwmanifest.xml
Disallow /?p=*
Disallow /?replytocom*
Disallow /?captcha*
Disallow /?trashed*
Disallow /*/?_gl=
Back to top

Other Records

Field Value
sitemap https://tarelka.pro/sitemap.xml
Back to top

Comments

  • global
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top