kenpom.com
robots.txt

Robots Exclusion Standard data for kenpom.com

Resource Scan

Scan Details

Site Domain kenpom.com
Base Domain kenpom.com
Scan Status Ok
Last Scan2026-03-09T17:10:46+00:00
Next Scan 2026-04-08T17:10:46+00:00

Last Scan

Scanned2026-03-09T17:10:46+00:00
URL https://kenpom.com/robots.txt
Domain IPs 104.26.8.205, 104.26.9.205, 172.67.75.164, 2606:4700:20::681a:8cd, 2606:4700:20::681a:9cd, 2606:4700:20::ac43:4ba4
Response IP 104.26.9.205
Found Yes
Hash 843af39c96dd7c49cd58c9733ead377cc780155220adfdc0ff52fd53ec88a0d9
SimHash 7046d6e8e3a3

Groups

jikespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /blog/http%3A/
Disallow /blog/blog/
Disallow /blog/weblog/
Disallow /blog/page/
Disallow /team.php
Disallow /conf.php
Disallow /player.php
Disallow /box.php
Disallow /archive.php

Other Records

Field Value
crawl-delay 5

Comments

  • Disallow: /blog/index.php/