snd51.ru
robots.txt
Robots Exclusion Standard data for snd51.ru
Resource Scan
Scan Details
| Site Domain | snd51.ru |
| Base Domain | snd51.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-16T00:16:23+00:00 |
| Next Scan | 2024-11-15T00:16:23+00:00 |
Last Scan
| Scanned | 2024-10-16T00:16:23+00:00 |
| URL | https://snd51.ru/robots.txt |
| Domain IPs | 104.21.32.209, 172.67.155.35, 2606:4700:3030::6815:20d1, 2606:4700:3037::ac43:9b23 |
| Response IP | 104.21.32.209 |
| Found | Yes |
| Hash | e5ea8fd14d46346eedf1c12695a26127d11f5518664fc99035b887f6e073078c |
| SimHash | 2030fb73cc70 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /? |
| Disallow | /wp- |
| Disallow | /wp/ |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search/ |
| Disallow | /author/ |
| Disallow | /users/ |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */embed |
| Disallow | */wlwmanifest.xml |
| Disallow | /xmlrpc.php |
| Disallow | *utm*%3D |
| Disallow | *openstat%3D |
Warnings
- 2 invalid lines.
- `host` is not a known field.