de.olight.com
robots.txt

Robots Exclusion Standard data for de.olight.com

Resource Scan

Scan Details

Site Domain de.olight.com
Base Domain olight.com
Scan Status Ok
Last Scan2025-10-12T04:18:48+00:00
Next Scan 2025-11-11T04:18:48+00:00

Last Scan

Scanned2025-10-12T04:18:48+00:00
URL https://de.olight.com/robots.txt
Domain IPs 13.35.37.104, 13.35.37.12, 13.35.37.59, 13.35.37.93
Response IP 13.35.37.104
Found Yes
Hash 0b031314b3c785cb27336fb926e48152006c7af9bf8c6e5a810c8e1cb2824293
SimHash 4c9d5c36123b

Groups

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

googlebot|bingbot

Rule Path
Allow /sitemap_*.xml

Other Records

Field Value
crawl-delay 20

facebookexternalhit

Rule Path
Disallow /
Disallow /dynamic/
Disallow /search/
Disallow /admin/

Other Records

Field Value
crawl-delay 10

meta-externalfetcher

Rule Path
Disallow /
Disallow /admin/
Disallow /search/
Disallow /dynamic/

Other Records

Field Value
crawl-delay 10

meta-externalagent

Rule Path
Disallow /
Disallow /admin/
Disallow /search/
Disallow /dynamic/
Disallow /user
Disallow /login
Disallow /forgetPwd
Disallow /setting
Disallow /address
Disallow /error
Disallow /pay
Disallow /cart
Disallow /register
Disallow /checkout
Disallow /checkout?params=*
Disallow /*order
Disallow /order?status=*
Disallow /*myMessage
Disallow /mySales
Disallow /myStory
Disallow /myOCoin
Disallow /myBonus
Disallow /myCoupon
Disallow /affectionCard
Disallow /couponCenter
Disallow /earnRewards
Disallow /wishList
Disallow /member/pointsDetails
Disallow /search
Disallow /catalogsearch*
Disallow /search?keyword=*
Disallow /search?couponId=*
Disallow /%20
Disallow /evaluation
Disallow /landing-page
Disallow /exclusive_benefit
Disallow /back-program
Disallow /repeat_customer_program
Disallow /*-coin
Disallow /*-ocoin
Disallow /*-diamond-*
Disallow /recall.html?id=*
Disallow /recall/agreement
Disallow /activities.html?id=*
Disallow /s/*
Disallow /suggestions
Disallow /*skuId%3D*
Disallow /*productId%3D*
Disallow /*blogLabelId%3D*
Disallow /blog/detail.html?id=*
Disallow /article.html?id=*
Disallow /*.pdf$

Other Records

Field Value
crawl-delay 10

Comments

  • Block Ahrefs crawlers
  • Google/Bing/特殊配置
  • 限制 FacebookExternalHit 爬虫
  • 限制 meta-externalfetcher
  • 限制 meta-externalagent