mtv.fi
robots.txt

Robots Exclusion Standard data for mtv.fi

Resource Scan

Scan Details

Site Domain mtv.fi
Base Domain mtv.fi
Scan Status Ok
Last Scan2024-11-02T15:38:23+00:00
Next Scan 2024-11-09T15:38:23+00:00

Last Scan

Scanned2024-11-02T15:38:23+00:00
URL https://mtv.fi/robots.txt
Redirect https://www.mtv.fi:443/robots.txt
Redirect Domain www.mtv.fi
Redirect Base mtv.fi
Domain IPs 13.50.159.11, 16.170.122.217, 51.20.62.225
Redirect IPs 2600:9000:248c:1e00:15:ee9d:a1c0:93a1, 2600:9000:248c:8200:15:ee9d:a1c0:93a1, 2600:9000:248c:9600:15:ee9d:a1c0:93a1, 2600:9000:248c:be00:15:ee9d:a1c0:93a1, 2600:9000:248c:d000:15:ee9d:a1c0:93a1, 2600:9000:248c:dc00:15:ee9d:a1c0:93a1, 2600:9000:248c:ee00:15:ee9d:a1c0:93a1, 2600:9000:248c:f200:15:ee9d:a1c0:93a1, 52.84.45.101, 52.84.45.20, 52.84.45.65, 52.84.45.8
Response IP 108.157.229.16
Found Yes
Hash c04741f6995e3d70970b59d0b0171af10fef4e6efebe15f0a2335a0cb14bb691
SimHash 3a555841a513

Groups

*

Rule Path
Disallow /rss_feeds

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mtv.fi/sitemap.xml