dailycaller.os.tc
robots.txt
Robots Exclusion Standard data for dailycaller.os.tc
Resource Scan
Scan Details
| Site Domain | dailycaller.os.tc |
| Base Domain | os.tc |
| Scan Status | Ok |
| Last Scan | 2025-10-21T22:15:06+00:00 |
| Next Scan | 2025-11-20T22:15:06+00:00 |
Last Scan
| Scanned | 2025-10-21T22:15:06+00:00 |
| URL | https://dailycaller.os.tc/robots.txt |
| Domain IPs | 104.16.77.117, 104.16.78.117, 2606:4700::6810:4d75, 2606:4700::6810:4e75 |
| Response IP | 104.16.78.117 |
| Found | Yes |
| Hash | 7cd93baed77166c965d6eebaad53bd3988c46564ce3a99611a2e8b015bdc722e |
| SimHash | b28f6f8f6c52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | *.php |
| Disallow | result.php |
| Disallow | category/ |
| Disallow | user/ |
| Disallow | users/ |
| Disallow | /users/* |
| Disallow | login/ |
| Disallow | /privacy_policy |
Comments