mtv.fi
robots.txt
Robots Exclusion Standard data for mtv.fi
Resource Scan
Scan Details
Site Domain | mtv.fi |
Base Domain | mtv.fi |
Scan Status | Ok |
Last Scan | 2024-11-02T15:38:23+00:00 |
Next Scan | 2024-11-09T15:38:23+00:00 |
Last Scan
Scanned | 2024-11-02T15:38:23+00:00 |
URL | https://mtv.fi/robots.txt |
Redirect | https://www.mtv.fi:443/robots.txt |
Redirect Domain | www.mtv.fi |
Redirect Base | mtv.fi |
Domain IPs | 13.50.159.11, 16.170.122.217, 51.20.62.225 |
Redirect IPs | 2600:9000:248c:1e00:15:ee9d:a1c0:93a1, 2600:9000:248c:8200:15:ee9d:a1c0:93a1, 2600:9000:248c:9600:15:ee9d:a1c0:93a1, 2600:9000:248c:be00:15:ee9d:a1c0:93a1, 2600:9000:248c:d000:15:ee9d:a1c0:93a1, 2600:9000:248c:dc00:15:ee9d:a1c0:93a1, 2600:9000:248c:ee00:15:ee9d:a1c0:93a1, 2600:9000:248c:f200:15:ee9d:a1c0:93a1, 52.84.45.101, 52.84.45.20, 52.84.45.65, 52.84.45.8 |
Response IP | 108.157.229.16 |
Found | Yes |
Hash | c04741f6995e3d70970b59d0b0171af10fef4e6efebe15f0a2335a0cb14bb691 |
SimHash | 3a555841a513 |
Groups
*
Rule | Path |
---|---|
Disallow | /rss_feeds |
Other Records
Field | Value |
---|---|
sitemap | https://www.mtv.fi/sitemap.xml |