rtl.hr
robots.txt
Robots Exclusion Standard data for rtl.hr
Resource Scan
Scan Details
| Site Domain | rtl.hr |
| Base Domain | rtl.hr |
| Scan Status | Ok |
| Last Scan | 2024-11-19T22:02:27+00:00 |
| Next Scan | 2024-11-20T22:02:27+00:00 |
Last Scan
| Scanned | 2024-11-19T22:02:27+00:00 |
| URL | https://rtl.hr/robots.txt |
| Redirect | https://www.rtl.hr/robots_cdn.txt |
| Redirect Domain | www.rtl.hr |
| Redirect Base | rtl.hr |
| Domain IPs | 18.155.68.68, 18.155.68.71, 18.155.68.73, 18.155.68.9, 2600:9000:23d2:3000:5:12b5:11c0:93a1, 2600:9000:23d2:3400:5:12b5:11c0:93a1, 2600:9000:23d2:4800:5:12b5:11c0:93a1, 2600:9000:23d2:5000:5:12b5:11c0:93a1, 2600:9000:23d2:8400:5:12b5:11c0:93a1, 2600:9000:23d2:b200:5:12b5:11c0:93a1, 2600:9000:23d2:c600:5:12b5:11c0:93a1, 2600:9000:23d2:c800:5:12b5:11c0:93a1 |
| Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Response IP | 199.232.46.133 |
| Found | Yes |
| Hash | 05bd44832b996d9132c0da63ae2e8e89bc45867758e0d171b82d4328e1087839 |
| SimHash | 6c40dc60cf12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /trazi |
| Disallow | /bin/ |
| Disallow | /lbin/ |
| Disallow | /adserver/ |
| Disallow | /users/ |
| Disallow | *modal%3A* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rtl.hr/sitemaps/sites/30012 |