widget.time.is
robots.txt
Robots Exclusion Standard data for widget.time.is
Resource Scan
Scan Details
| Site Domain | widget.time.is |
| Base Domain | time.is |
| Scan Status | Ok |
| Last Scan | 2025-12-14T05:43:00+00:00 |
| Next Scan | 2026-01-13T05:43:00+00:00 |
Last Scan
| Scanned | 2025-12-14T05:43:00+00:00 |
| URL | https://widget.time.is/robots.txt |
| Domain IPs | 104.26.12.54, 104.26.13.54, 172.67.68.157, 2606:4700:20::681a:c36, 2606:4700:20::681a:d36, 2606:4700:20::ac43:449d |
| Response IP | 104.26.12.54 |
| Found | Yes |
| Hash | ceb5f426536212c12cf6772ac4596aac772ee3fc1be610ebef16e2f1d43da2ec |
| SimHash | 5854cb68cfd5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /compare/*%3B* |
| Disallow | /*_2010* |
| Disallow | /*Jan_2011* |
| Disallow | /0* |
| Disallow | /1* |
| Disallow | /200* |
| Disallow | /202* |
| Disallow | /203* |
| Disallow | /204* |
| Disallow | /205* |
| Disallow | /206* |
| Disallow | *.js |
| Disallow | /suggest/ |
| Disallow | */suggest/ |
| Disallow | /sync/ |
| Disallow | /s/ |
| Disallow | */s/ |
| Disallow | /t/ |
| Disallow | /h/ |
| Disallow | */h/ |
| Disallow | /r/ |
| Disallow | */r/ |
| Disallow | /en/ |
| Disallow | /en_gb/ |
| Disallow | /*/just/ |
| Disallow | /*/info/ |
| Disallow | /*/map/ |
| Disallow | /*/compare/ |
| Disallow | /*fb_xd_fragment |
| Disallow | /ad/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Warnings
- 1 invalid line.
- `request-rate` is not a known field.
Comments