dv1tjjifbk9h9.cloudfront.net
robots.txt
Robots Exclusion Standard data for dv1tjjifbk9h9.cloudfront.net
Resource Scan
Scan Details
| Site Domain | dv1tjjifbk9h9.cloudfront.net |
| Base Domain | dv1tjjifbk9h9.cloudfront.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-16T19:06:15+00:00 |
| Next Scan | 2024-11-14T19:06:15+00:00 |
Last Successful Scan
| Scanned | 2023-04-17T23:04:24+00:00 |
| URL | https://dv1tjjifbk9h9.cloudfront.net/robots.txt |
| Domain IPs | 13.35.18.130, 13.35.18.208, 13.35.18.31, 13.35.18.90, 2600:9000:20c7:1600:12:b734:ff40:21, 2600:9000:20c7:1a00:12:b734:ff40:21, 2600:9000:20c7:3400:12:b734:ff40:21, 2600:9000:20c7:5000:12:b734:ff40:21, 2600:9000:20c7:8e00:12:b734:ff40:21, 2600:9000:20c7:b000:12:b734:ff40:21, 2600:9000:20c7:b200:12:b734:ff40:21, 2600:9000:20c7:fe00:12:b734:ff40:21 |
| Response IP | 13.35.18.31 |
| Found | Yes |
| Hash | 2c0e5c3ffcea337a2261ad72d68dc71c087ed132f16142e36cfa02802bcca165 |
| SimHash | 7a0c884eca13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /z/*/*/*/* |
| Disallow | /tv/*/*/*/*/* |
| Disallow | /radio/*/*/*/*/* |
| Disallow | /schedule/*/*/*/*/* |
| Disallow | /*?p=* |
| Disallow | /comments/* |
| Disallow | /embed/* |
| Disallow | /s?k=* |
| Disallow | /navigation.html |
| Disallow | /Navigation/* |
| Disallow | /office365/login.html |
| Disallow | /podcast/sublink/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rus.ozodi.org/sitemap.xml |
Warnings
- `clean-param` is not a known field.