best-stroy.ru
robots.txt
Robots Exclusion Standard data for best-stroy.ru
Resource Scan
Scan Details
| Site Domain | best-stroy.ru |
| Base Domain | best-stroy.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-03T12:21:33+00:00 |
| Next Scan | 2024-06-10T12:21:33+00:00 |
Last Scan
| Scanned | 2024-06-03T12:21:33+00:00 |
| URL | https://best-stroy.ru/robots.txt |
| Domain IPs | 104.21.19.19, 172.67.184.119, 2606:4700:3032::ac43:b877, 2606:4700:3036::6815:1313 |
| Response IP | 104.21.19.19 |
| Found | Yes |
| Hash | 301dba8927f262bb2210aa0cd386448287d9f7b7466e8cff4979dedf08ae71d9 |
| SimHash | dd06af0863b7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*/$ |
| Disallow | /categories |
| Disallow | /cities |
| Disallow | /companies |
| Disallow | /imports |
| Disallow | /products |
| Disallow | /promotions |
| Disallow | /search |
| Disallow | /sponsors |
| Disallow | /subscribes |
| Disallow | /tidings |
| Disallow | /topics |
| Disallow | /users |
| Disallow | /direct |
| Disallow | /robokassa |
| Disallow | /tovary-i-uslugi_*/page |
| Disallow | /tovary_*/page |
| Disallow | /uslugi_*/page |
| Disallow | /katalog_*/page |
| Disallow | /kompanii_*/page |
| Disallow | /statji_*/page |
| Disallow | /forum_*/page |
| Disallow | /*/comments/create |
| Allow | /css*? |
| Allow | /js*? |
| Allow | /img*? |
| Allow | /fonts*? |
| Allow | /foto-*? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://best-stroy.ru/sitemap.xml |
Warnings
- `host` is not a known field.