telemundocleveland.com
robots.txt

Robots Exclusion Standard data for telemundocleveland.com

Resource Scan

Scan Details

Site Domain telemundocleveland.com
Base Domain telemundocleveland.com
Scan Status Ok
Last Scan2024-11-13T16:23:37+00:00
Next Scan 2024-11-20T16:23:37+00:00

Last Scan

Scanned2024-11-13T16:23:37+00:00
URL https://telemundocleveland.com/robots.txt
Redirect https://www.telemundocleveland.com:443/robots.txt
Redirect Domain www.telemundocleveland.com
Redirect Base telemundocleveland.com
Domain IPs 15.197.211.237, 3.33.234.1
Redirect IPs 23.209.46.90, 23.209.46.91, 2600:1413:b000:13::b857:c18d, 2600:1413:b000:13::b857:c19d
Response IP 23.45.207.174
Found Yes
Hash b904f0425f2c7c7281958c3f02a4b163f1850b3269c8dc1116b5a9bec7b1f87e
SimHash 322ada5269f3

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Allow /noticias/
Allow /el-tiempo/
Allow /deportes/
Disallow /video/$
Disallow /video/shared/
Disallow /video/vod-recording/
Disallow /video/livestream/
Disallow /video/livestream2/
Disallow /*?outputType=apps

Other Records

Field Value
sitemap https://www.telemundocleveland.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.telemundocleveland.com/arc/outboundfeeds/news-sitemap-index/category/noticias/?outputType=xml
sitemap https://www.telemundocleveland.com/arc/outboundfeeds/video-sitemap/?outputType=xml
sitemap https://www.telemundocleveland.com/arc/outboundfeeds/sitemap-section-index/?outputType=xml