Log In Sign Up

parsesite.ru
robots.txt

Robots Exclusion Standard data for parsesite.ru

Resource Scan

Scan Details

Site Domain parsesite.ru
Base Domain parsesite.ru
Scan Status Ok
Last Scan2024-11-15T18:58:12+00:00
Next Scan 2024-11-22T18:58:12+00:00

Last Scan

Scanned2024-11-15T18:58:12+00:00
URL https://parsesite.ru/robots.txt
Domain IPs 92.255.106.119
Response IP 92.255.106.119
Found Yes
Hash 75756ee9db7653fbffe7c5dfe25158f3de0db0c3eeeaff39568a64549819ccfc
SimHash 4b05ec05ce33

Groups

*

Rule Path
Allow /
Disallow /ru/user/sign-in
Disallow /ru/user/SignIn
Disallow /ru/user/SignUp
Disallow /ru/user/ForgotPassword
Disallow /en/user/sign-in
Disallow /en/user/SignIn
Disallow /en/user/SignUp
Disallow /en/user/ForgotPassword
Disallow /*?*
Disallow /ru/cost/xn--90acee4apdbaqsh.xn--p1ai
Disallow /goto/
Disallow /goto/*
Disallow /goto/*.
Disallow /redirect.php
Disallow /redirect.php*
Disallow /redirect.php*.
Disallow /index.php
Disallow /index.php*
Disallow /index.php*.
Disallow /debug*
Disallow /comments*
Back to top

Other Records

Field Value
sitemap https://parsesite.ru/sitemap.xml
Back to top

Comments

  • Disallow: */calculate?*
  • Disallow: */upcoming*
Back to top

Warnings

  • `host` is not a known field.
Back to top