vsepostavshiki.ru
robots.txt
Robots Exclusion Standard data for vsepostavshiki.ru
Resource Scan
Scan Details
Site Domain | vsepostavshiki.ru |
Base Domain | vsepostavshiki.ru |
Scan Status | Ok |
Last Scan | 2025-04-20T10:31:34+00:00 |
Next Scan | 2025-04-27T10:31:34+00:00 |
Last Scan
Scanned | 2025-04-20T10:31:34+00:00 |
URL | https://vsepostavshiki.ru/robots.txt |
Domain IPs | 104.21.20.211, 172.67.194.119, 2606:4700:3035::ac43:c277, 2606:4700:3037::6815:14d3 |
Response IP | 104.21.20.211 |
Found | Yes |
Hash | 39ddb649ca596bca82faf373e056e28532a1c9275936f070f268f6128097d4c4 |
SimHash | 7d84f863b6f2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /auth |
Disallow | /tags/* |
Disallow | /subscriptions/* |
Disallow | /posts?* |
Disallow | /groups/index/* |
Disallow | /comments* |
Disallow | /comments/* |
Disallow | /activity |
Disallow | /refresh* |
Disallow | /users/* |
Disallow | /*?page=* |
Disallow | /*page%3D* |
Disallow | /complain/* |
Disallow | /redirect?url= |
Disallow | /redirect* |
Disallow | /auth/* |
Disallow | /pages$ |
Disallow | /geo*$ |
Disallow | /photos/download/* |
Disallow | /subscriptions/* |
Disallow | /rating*$ |
Disallow | /groups/index$ |
Disallow | /search |
Disallow | /login |
Disallow | /registration |
Disallow | /places/events/* |
Disallow | /moderation/ |
Disallow | /tovar/edit/ |
Disallow | /tovar/add |
Disallow | /rss/feed/comments |
Disallow | /billing/* |
Disallow | /price* |
Disallow | /view-price |
Disallow | /novosti_saita/add |
Disallow | /novosti_saita/edit* |
Disallow | /obyavlen/add |
Disallow | /obyavlen/edit* |
Disallow | /obyavlen/edit* |
Disallow | /places/* |
Allow | /places/postavshiki* |
Disallow | /postavshiki*strana* |
Disallow | /favorites/* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://vsepostavshiki.ru/sitemap.xml |
Warnings
- `host` is not a known field.