longos.com
robots.txt

Robots Exclusion Standard data for longos.com

Resource Scan

Scan Details

Site Domain longos.com
Base Domain longos.com
Scan Status Ok
Last Scan2024-09-21T12:31:29+00:00
Next Scan 2024-10-05T12:31:29+00:00

Last Scan

Scanned2024-09-21T12:31:29+00:00
URL https://longos.com/robots.txt
Redirect https://www.longos.com/robots.txt
Redirect Domain www.longos.com
Redirect Base longos.com
Domain IPs 96.17.96.15, 96.17.96.24
Redirect IPs 96.17.96.15, 96.17.96.24
Response IP 23.44.4.185
Found Yes
Hash bb4ca313ff616fb0d86deaf605d0fd9e57a26bda2bfb342e45951c2605c8e6b5
SimHash 00501dba4b17

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout/delivery-settings
Disallow /checkout/review-order
Disallow /checkout/payment-details
Disallow /my-account/account-information
Disallow /my-account/thank-you-rewards
Disallow /my-lists
Disallow /my-orders
Disallow /my-favourites
Disallow /autoReorder
Disallow /reserve-delivery
Disallow /reserve-pickup

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

chinasospider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.longos.com/sitemap.xml

Comments

  • Allow search crawlers to discover the sitemap
  • For all robots
  • Block access to specific groups of pages
  • SPECIFICALLY DIS-ALLOW
  • YANDEX
  • BAIDU
  • CHINESE