spark.ru
robots.txt
Robots Exclusion Standard data for spark.ru
Resource Scan
Scan Details
| Site Domain | spark.ru |
| Base Domain | spark.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-02T10:15:46+00:00 |
| Next Scan | 2024-10-09T10:15:46+00:00 |
Last Scan
| Scanned | 2024-10-02T10:15:46+00:00 |
| URL | https://spark.ru/robots.txt |
| Domain IPs | 185.178.209.20 |
| Response IP | 185.178.209.20 |
| Found | Yes |
| Hash | 65b63ca1c3cf8e8cbd4c2a3618d1b350ef2b98e6f2e3677e158e7a0c43323721 |
| SimHash | 9816c1fa5cbb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dontVisitMe/ |
| Disallow | /admin/ |
| Disallow | /ajax/ |
| Disallow | /search |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /pma |
| Disallow | /*?*c= |
| Disallow | /*?*promo= |
| Disallow | /services |
| Disallow | /auth |
| Disallow | /rules |
| Disallow | /talk/ |
| Disallow | /user/settings |
| Disallow | /write |
| Disallow | /startup/*/blog$ |
| Disallow | /startup/*/wall |
| Disallow | /user/*/comments |
| Disallow | /user/*/blogs |
| Disallow | /feedback/$ |
| Disallow | /feedback/new/ |
| Disallow | /feedback/popular-daily/ |
| Disallow | /feedback/popular-monthly/ |
| Disallow | /feedback/popular-weekly/ |
| Disallow | /feedback/popular/ |
| Disallow | /feedback/hot/ |
| Disallow | /feedback/best/ |
| Disallow | /startups-popular/0/1 |
| Disallow | /startups-new/0/1 |
| Disallow | /startups/0/1 |
| Disallow | /*_gl%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://spark.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.