setup.ru
robots.txt

Robots Exclusion Standard data for setup.ru

Resource Scan

Scan Details

Site Domain setup.ru
Base Domain setup.ru
Scan Status Ok
Last Scan2024-09-15T14:22:24+00:00
Next Scan 2024-10-15T14:22:24+00:00

Last Scan

Scanned2024-09-15T14:22:24+00:00
URL https://setup.ru/robots.txt
Redirect https://www.setup.ru/robots.txt
Redirect Domain www.setup.ru
Redirect Base setup.ru
Domain IPs 159.69.230.130
Redirect IPs 159.69.230.130
Response IP 159.69.230.130
Found Yes
Hash bb3e151a341a626d89e00e7bc7df06a08a6a802e53d40e91064b0d0c2e321d22
SimHash 470f58c05791

Groups

*

Rule Path
Disallow /?r=*
Disallow /?*
Disallow /client/auth
Disallow /client/recover
Disallow /client/sites
Disallow /site_preview
Disallow /about/improverate
Disallow /unsubscribe

yandex

Rule Path
Disallow /?r=*
Disallow /?*
Disallow /client/auth
Disallow /client/recover
Disallow /client/sites
Disallow /site_preview
Disallow /unsubscribe
Disallow /about/improverate

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.setup.ru/sitemap.xml

Warnings

  • `host` is not a known field.