dailykos.com
robots.txt
Robots Exclusion Standard data for dailykos.com
Resource Scan
Scan Details
| Site Domain | dailykos.com |
| Base Domain | dailykos.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T17:08:14+00:00 |
| Next Scan | 2024-11-16T17:08:14+00:00 |
Last Scan
| Scanned | 2024-11-09T17:08:14+00:00 |
| URL | https://dailykos.com/robots.txt |
| Domain IPs | 108.156.133.102, 108.156.133.21, 108.156.133.96, 108.156.133.99 |
| Response IP | 108.156.133.96 |
| Found | Yes |
| Hash | 0ee71f50f0dd8d2c8dd74c07436a1b5e54eba3bfcc0f7c116c7aad7942e820b2 |
| SimHash | ed55aa08c8d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /comments/ |
| Disallow | /comment/ |
| Disallow | /api/v1/users/ |
| Disallow | /user/ |
| Disallow | /search |
| Disallow | /part |
| Disallow | /ajax |
| Disallow | /softlaunch |
| Disallow | /history |
Comments