ksl.com
robots.txt

Robots Exclusion Standard data for ksl.com

Resource Scan

Scan Details

Site Domain ksl.com
Base Domain ksl.com
Scan Status Ok
Last Scan2024-06-23T19:57:42+00:00
Next Scan 2024-06-30T19:57:42+00:00

Last Scan

Scanned2024-06-23T19:57:42+00:00
URL https://ksl.com/robots.txt
Redirect https://www.ksl.com/robots.txt
Redirect Domain www.ksl.com
Redirect Base ksl.com
Domain IPs 34.144.234.52
Redirect IPs 34.144.234.52
Response IP 34.144.234.52
Found Yes
Hash 57976f9bdae3872644aa6fa37881e0bfdb6acd7de25880d90fa09caf99b21d4f
SimHash 8906882abf90

Groups

oodlebot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

*

Rule Path
Allow /public/member/login
Allow /public/member/new
Disallow /public/member/
Disallow /public/cmscommentAbuse/
Disallow /*?print=1
Disallow /ad_logger/
Disallow /*nid%3D1070
Disallow /auto/stat/
Disallow /auto/search/ad-carousel
Disallow /homes/stat/
Disallow /jobs/stat/
Disallow /jobs/emailafriend/
Disallow *format/html
Disallow /ajax/yahoo_stocks.php

ksl-crawler

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.ksl.com/sitemapIndex.xml
sitemap https://www.ksl.com/google-news-sitemap.xml