smm-e.ru
robots.txt
Robots Exclusion Standard data for smm-e.ru
Resource Scan
Scan Details
| Site Domain | smm-e.ru |
| Base Domain | smm-e.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-26T00:53:33+00:00 |
| Next Scan | 2024-11-24T00:53:33+00:00 |
Last Successful Scan
| Scanned | 2024-04-28T23:25:17+00:00 |
| URL | https://smm-e.ru/robots.txt |
| Domain IPs | 92.53.78.245 |
| Response IP | 92.53.78.245 |
| Found | Yes |
| Hash | 4b4d34807f3f2b9ac1b88db02ed18434fa47b3f602d53eab934aec4d128db796 |
| SimHash | 5d0099cf2c22 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *_sync_ign* |
| Disallow | *_work/* |
| Disallow | *.gz |
| Disallow | *.php |
| Disallow | *.psd |
| Disallow | *.py |
| Disallow | *.rar |
| Disallow | *.txt |
| Disallow | *.zip |
| Disallow | *.woff |
| Disallow | *.woff2 |
| Disallow | */_cm* |
| Disallow | */adm/* |
| Disallow | */assets/css |
| Disallow | */assets/libs |
| Disallow | */cb/* |
| Disallow | */embed |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */test/wp/* |
| Disallow | /admin-panel/ |
| Disallow | /ajax/ |
| Disallow | /assets/errors-pages |
| Disallow | /search/ |
| Disallow | /services/auth |
| Disallow | /services/vk/cb/ |
| Disallow | /test/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-includes/ |
| Allow | /assets/images/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://smm-e.ru/sitemap.xml |
| sitemap | https://smm-e.ru/sitemap.rss |
| sitemap | https://smm-e.ru/sitemap.txt |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.