cars.ksl.com
robots.txt

Robots Exclusion Standard data for cars.ksl.com

Resource Scan

Scan Details

Site Domain cars.ksl.com
Base Domain ksl.com
Scan Status Ok
Last Scan2024-06-11T22:06:16+00:00
Next Scan 2024-06-18T22:06:16+00:00

Last Scan

Scanned2024-06-11T22:06:16+00:00
URL https://cars.ksl.com/robots.txt
Domain IPs 64.147.131.201
Response IP 64.147.131.201
Found Yes
Hash 6f7d1264ce20959be2e2eaeb35dc3690648946d743df295258088470eb611d22
SimHash 69045a11cdd1

Groups

oodlebot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Disallow /*?*emailingseller

ksl-crawler

Rule Path
Allow /

*

Rule Path
Disallow /*?*emailingseller

Other Records

Field Value
sitemap https://cars.ksl.com/sitemap-index.xml

Comments

  • Block URLs containing the query parameter `emailingseller`