Log In Sign Up

sugargoo.com
robots.txt

Robots Exclusion Standard data for sugargoo.com

Resource Scan

Scan Details

Site Domain sugargoo.com
Base Domain sugargoo.com
Scan Status Ok
Last Scan2026-04-02T11:13:41+00:00
Next Scan 2026-05-02T11:13:41+00:00

Last Scan

Scanned2026-04-02T11:13:41+00:00
URL https://sugargoo.com/robots.txt
Redirect https://www.sugargoo.com:443/robots.txt
Redirect Domain www.sugargoo.com
Redirect Base sugargoo.com
Domain IPs 18.209.3.156, 3.221.197.254, 52.2.157.249, 52.20.158.13, 52.201.166.1, 54.152.253.81
Redirect IPs 13.33.45.2, 13.33.45.20, 13.33.45.27, 13.33.45.49, 2600:9000:229f:1600:6:f2a3:5600:93a1, 2600:9000:229f:3800:6:f2a3:5600:93a1, 2600:9000:229f:3a00:6:f2a3:5600:93a1, 2600:9000:229f:5400:6:f2a3:5600:93a1, 2600:9000:229f:7400:6:f2a3:5600:93a1, 2600:9000:229f:8400:6:f2a3:5600:93a1, 2600:9000:229f:9000:6:f2a3:5600:93a1, 2600:9000:229f:da00:6:f2a3:5600:93a1
Response IP 13.33.45.49
Found Yes
Hash cf8a8ccfa79c8cef1fc6559849c3e332b185faae7b6201cc908c19389d05b13c
SimHash 6b10d914e571

Groups

*

Rule Path
Allow /
Allow /mall
Allow /freight-estimate
Allow /coupons
Allow /tracking
Allow /contact-us
Allow /size-conversion-cn-uk-us-eu-intl
Allow /taobao
Allow /activity/
Allow /black-friday
Allow /bestsellers
Allow /products-list
Allow /help-center
Allow /help-center/
Allow /products
Allow /search
Allow /shops/
Allow /affiliate
Allow /order/transport
Allow /bag-sharing
Allow /pages/view
Allow /business
Allow /category/
Disallow /admin/
Disallow /api/
Disallow /game
Disallow /lottery-draw
Disallow /search/shops
Disallow /login
Disallow /member/
Disallow /order/
Disallow /cart
Disallow /bag/
Disallow /payment/
Disallow /share
Disallow /*?*
Disallow /*%26*
Disallow /*.js$
Disallow /*.css$
Disallow /*.json$
Disallow /*.xml$
Disallow /assets/
Disallow /dist/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.sugargoo.com/sitemap.xml
Back to top

Comments

  • Allow public pages to be crawled
  • User related pages and directories that are prohibited from crawling
  • Prohibit crawling dynamic query parameters (to avoid unlimited crawling and server resource consumption)
  • Prohibit capturing static resource files
  • Crawling delay (unit: seconds)
  • Sitemap
Back to top