www.a.ubuy.com.kw
robots.txt

Robots Exclusion Standard data for www.a.ubuy.com.kw

Resource Scan

Scan Details

Site Domain www.a.ubuy.com.kw
Base Domain ubuy.com.kw
Scan Status Ok
Last Scan2024-10-18T18:34:13+00:00
Next Scan 2024-11-01T18:34:13+00:00

Last Scan

Scanned2024-10-18T18:34:13+00:00
URL https://www.a.ubuy.com.kw/robots.txt
Domain IPs 108.156.133.22, 108.156.133.3, 108.156.133.39, 108.156.133.82
Response IP 108.156.133.22
Found Yes
Hash 12793feea35c231921af22ad53d46c3658d412856b880d7fd63da3d97b933915
SimHash 1110e85d9bb0

Groups

*

Rule Path
Disallow /tag/
Disallow */ubcheckout/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow /poll/
Disallow */sendfriend/
Disallow */ubuywishlist/
Disallow */customer/account/
Disallow */ubuycom/pages
Disallow */webpool/
Disallow */ubcommon/
Disallow */wp-login.php
Disallow */storeswap
Disallow */ubpay/
Disallow */update-store
Disallow */sales/order/
Disallow */rest-apps/
Disallow */curated-store/
Disallow */am/followup/
Disallow */xmlrpc.php
Disallow /*?SID=
Disallow *?cf=cf
Disallow *%26cf%3Dcf
Disallow *?sort_by=
Disallow *%26sort_by%3D
Disallow *?store=
Disallow *%26store%3D
Disallow *?node_id=
Disallow *%26node_id%3D
Disallow *?q=
Disallow *%26q%3D
Disallow *?ref=
Disallow *%26ref%3D
Disallow *?inf=
Disallow *%26inf%3D
Disallow *ref%3Dshop
Disallow *%26sort%3D
Disallow *?price_range=
Disallow *?brand=
Disallow *load-change-country
Disallow *?preview=true
Disallow /html-sitemap/ubuybrands
Disallow */amp/*

*

Rule Path
Disallow /blogs/cgi-bin/
Disallow /blogs/Hot-Deals/
Disallow /blogs/?s=
Disallow /blogs/tag/
Disallow /blogs/feed/

Other Records

Field Value
sitemap https://www.a.ubuy.com.kw/sitemap.xml
sitemap https://www.a.ubuy.com.kw/blogs/sitemap_kw.xml

Comments

  • Paths (clean URLs)
  • Disallow: */.well-known/
  • Paths (no clean URLs)