setup.ru
robots.txt

Robots Exclusion Standard data for setup.ru

Resource Scan

Scan Details

Site Domain setup.ru
Base Domain setup.ru
Scan Status Ok
Last Scan2024-11-14T14:22:45+00:00
Next Scan 2024-12-14T14:22:45+00:00

Last Scan

Scanned2024-11-14T14:22:45+00:00
URL https://setup.ru/robots.txt
Redirect https://www.setup.ru/robots.txt
Redirect Domain www.setup.ru
Redirect Base setup.ru
Domain IPs 104.21.61.73, 172.67.207.57, 2606:4700:3032::ac43:cf39, 2606:4700:3036::6815:3d49
Redirect IPs 104.21.61.73, 172.67.207.57, 2606:4700:3032::ac43:cf39, 2606:4700:3036::6815:3d49
Response IP 104.21.61.73
Found Yes
Hash bb3e151a341a626d89e00e7bc7df06a08a6a802e53d40e91064b0d0c2e321d22
SimHash 470f58c05791

Groups

*

Rule Path
Disallow /?r=*
Disallow /?*
Disallow /client/auth
Disallow /client/recover
Disallow /client/sites
Disallow /site_preview
Disallow /about/improverate
Disallow /unsubscribe

yandex

Rule Path
Disallow /?r=*
Disallow /?*
Disallow /client/auth
Disallow /client/recover
Disallow /client/sites
Disallow /site_preview
Disallow /unsubscribe
Disallow /about/improverate

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.setup.ru/sitemap.xml

Warnings

  • `host` is not a known field.