service-scanner.ru
robots.txt
Robots Exclusion Standard data for service-scanner.ru
Resource Scan
Scan Details
Site Domain | service-scanner.ru |
Base Domain | service-scanner.ru |
Scan Status | Ok |
Last Scan | 2024-10-06T07:04:24+00:00 |
Next Scan | 2024-11-05T07:04:24+00:00 |
Last Scan
Scanned | 2024-10-06T07:04:24+00:00 |
URL | https://service-scanner.ru/robots.txt |
Domain IPs | 77.222.57.100 |
Response IP | 77.222.57.100 |
Found | Yes |
Hash | 405961fbe4a2a300c8735c229c018e2229ab0f04a88f92aa9e98c73867935e87 |
SimHash | c78fcb4267af |
Groups
*
Rule | Path |
---|---|
Disallow | /manager/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /goroda/ |
Disallow | /ajax.html |
Disallow | /errors.html |
Disallow | /import.html |
Disallow | /definition.html |
Disallow | *? |
Disallow | /assets/docs/ |
Disallow | /assets/export/ |
Disallow | /assets/import/ |
Disallow | /assets/modules/ |
Disallow | /assets/plugins/ |
Disallow | /assets/snippets/ |
Disallow | /install/ |
Disallow | /manager/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /? |
Disallow | /*? |
Disallow | /index.php |
Disallow | /import.html |
Allow | /core/cache/phpthumb/*.jpeg |
Allow | /core/cache/phpthumb/*.png |
Allow | /core/cache/phpthumb/*.svg |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
yandex
Rule | Path |
---|---|
Disallow | /manager/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /goroda/ |
Disallow | /ajax.html |
Disallow | /errors.html |
Disallow | /import.html |
Disallow | /definition.html |
Disallow | *? |
googlebot
Rule | Path |
---|---|
Disallow | /manager/ |
Disallow | /core/ |
Disallow | /connectors/ |
Disallow | /goroda/ |
Disallow | /ajax.html |
Disallow | /errors.html |
Disallow | /import.html |
Disallow | /definition.html |
Disallow | *? |
Allow | /core/cache/phpthumb/*.jpeg |
Allow | /core/cache/phpthumb/*.png |
Allow | /core/cache/phpthumb/*.svg |
Allow | /assets/cache/images/ |
Allow | /assets/modules/*.css |
Allow | /assets/modules/*.js |
Allow | /assets/plugins/*.css |
Allow | /assets/plugins/*.js |
Allow | /assets/snippets/*.css |
Allow | /assets/snippets/*.js |
Allow | /assets/ |
Allow | /css/ |
Other Records
Field | Value |
---|---|
sitemap | https://service-scanner.ru/sitemap.xml |
Warnings
- `host` is not a known field.