cmore.fi
robots.txt

Robots Exclusion Standard data for cmore.fi

Resource Scan

Scan Details

Site Domain cmore.fi
Base Domain cmore.fi
Scan Status Ok
Last Scan2024-05-13T22:54:16+00:00
Next Scan 2024-05-20T22:54:16+00:00

Last Scan

Scanned2024-05-13T22:54:16+00:00
URL https://cmore.fi/robots.txt
Redirect https://www.mtv.fi:443/robots.txt
Redirect Domain www.mtv.fi
Redirect Base mtv.fi
Domain IPs 13.49.156.102, 16.170.124.108, 51.20.27.129
Redirect IPs 18.161.6.111, 18.161.6.115, 18.161.6.24, 18.161.6.73
Response IP 18.165.171.11
Found Yes
Hash c04741f6995e3d70970b59d0b0171af10fef4e6efebe15f0a2335a0cb14bb691
SimHash 3a555841a513

Groups

*

Rule Path
Disallow /rss_feeds

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mtv.fi/sitemap.xml