uk.olight.com
robots.txt

Robots Exclusion Standard data for uk.olight.com

Resource Scan

Scan Details

Site Domain uk.olight.com
Base Domain olight.com
Scan Status Ok
Last Scan2025-12-12T02:23:33+00:00
Next Scan 2026-01-11T02:23:33+00:00

Last Scan

Scanned2025-12-12T02:23:33+00:00
URL https://uk.olight.com/robots.txt
Domain IPs 3.170.229.14, 3.170.229.47, 3.170.229.5, 3.170.229.90
Response IP 3.170.229.90
Found Yes
Hash 27a7a7e8b84a064f619c0a18ef8e9d83d3ea42f1255175ac0974ddcbe312c9b7
SimHash 4ddc1c373330

Groups

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /sitemap.xml
Allow /sitemap_listing_category.xml
Allow /sitemap_blog_category.xml
Allow /sitemap_listing.xml
Allow /sitemap_article.xml
Allow /sitemap_tag.xml

bingbot

Rule Path
Allow /sitemap.xml
Allow /sitemap_listing_category.xml
Allow /sitemap_blog_category.xml
Allow /sitemap_listing.xml
Allow /sitemap_article.xml
Allow /sitemap_tag.xml

Other Records

Field Value
crawl-delay 20

facebot

Rule Path
Allow /sitemap.xml
Allow /sitemap_listing_category.xml
Allow /sitemap_blog_category.xml
Allow /sitemap_listing.xml
Allow /sitemap_article.xml
Allow /sitemap_tag.xml
Disallow /user
Disallow /login
Disallow /forgetPwd
Disallow /setting
Disallow /address
Disallow /error
Disallow /pay
Disallow /cart
Disallow /register
Disallow /checkout
Disallow /checkout?params=*
Disallow /order
Disallow /order?status=*
Disallow /myMessage
Disallow /mySales
Disallow /myStory
Disallow /myOCoin
Disallow /myBonus
Disallow /myCoupon
Disallow /affectionCard
Disallow /couponCenter
Disallow /earnRewards
Disallow /wishList
Disallow /member/pointsDetails
Disallow /search
Disallow /catalogsearch*
Disallow /search?keyword=*
Disallow /search?couponId=*
Disallow /%20
Disallow /evaluation
Disallow /landing-page
Disallow /exclusive_benefit
Disallow /back-program
Disallow /repeat_customer_program
Disallow /*-coin
Disallow /*-ocoin
Disallow /*-diamond-*
Disallow /recall.html?id=*
Disallow /recall/agreement
Disallow /activities.html?id=*
Disallow /s/*
Disallow /suggestions
Disallow /*skuId%3D*
Disallow /*productId%3D*
Disallow /*blogLabelId%3D*
Disallow /blog/detail.html?id=*
Disallow /article.html?id=*
Disallow /*.pdf$

Other Records

Field Value
crawl-delay 20

Comments

  • Block Ahrefs crawlers
  • 限制 FacebookExternalHit 爬虫