che168.com
robots.txt

Robots Exclusion Standard data for che168.com

Resource Scan

Scan Details

Site Domain che168.com
Base Domain che168.com
Scan Status Ok
Last Scan2024-06-10T04:27:15+00:00
Next Scan 2024-07-10T04:27:15+00:00

Last Scan

Scanned2024-06-10T04:27:15+00:00
URL https://www.che168.com/robots.txt
Domain IPs 120.52.95.238, 120.52.95.239, 218.12.76.167, 218.12.76.171
Response IP 120.52.95.238
Found Yes
Hash 382887a4a7ee24c36fc97ae8e3e578decb66af8112db723a5735034a468f5f64
SimHash f029396583d3

Groups

*

Rule Path
Disallow /Controls/
Disallow /css/
Disallow /Handler/
Disallow /images/
Disallow /Inc/
Disallow /js/
Disallow */a*_*m*
Disallow */nobrand/*
Disallow */nonebrand/*
Disallow */brand*
Disallow */jingjinji/*
Disallow */jiangzhehu/*
Disallow */guangshen/*
Disallow */yunguichuan/*
Disallow *-*
Disallow */s*-**/
Disallow */*/*/*-**/*
Disallow */suv-suva-suvb-suvc/*
Disallow /list/*/*/*/
Disallow */*/*/list/*
Disallow */CarDetail/*
Disallow *%26*
Disallow */?kw=*
Disallow */lianmeng/*/*.html*
Disallow */dealer/*/*.html?pvareaid=*
Disallow */lifan/*
Disallow */jilidihao/*
Disallow */fengtianrav4/*
Allow */a0_0msdgscncgpiltocsp*exx0/
Allow */a0_0ms1dgscncgpi1ltocspexx0/
Allow */a0_0ms8dgscncgpi1ltocspexx0/
Disallow *-*
Disallow */nlist/*
Disallow */series*

Comments

  • Robots.txt file from http://www.che168.com
  • 屏蔽老旧页面
  • 屏蔽多选车型页面
  • 屏蔽同品牌下车系多选
  • 屏蔽级别筛选重复页面
  • 老旧页面报错
  • 屏蔽垃圾搜索结果页
  • 屏蔽车源相关页面
  • 屏蔽已知带无效参数页面
  • 放开必要参数
  • 屏蔽复选相关页面
  • 屏蔽/nlist/页面
  • 屏蔽错误的车系页面