www.a.ubuy.com.kw
robots.txt

Robots Exclusion Standard data for www.a.ubuy.com.kw

Resource Scan

Scan Details

Site Domain www.a.ubuy.com.kw
Base Domain ubuy.com.kw
Scan Status Ok
Last Scan2024-05-31T14:19:11+00:00
Next Scan 2024-06-14T14:19:11+00:00

Last Scan

Scanned2024-05-31T14:19:11+00:00
URL https://www.a.ubuy.com.kw/robots.txt
Domain IPs 18.67.181.123, 18.67.181.34, 18.67.181.54, 18.67.181.74
Response IP 108.156.133.22
Found Yes
Hash a19b8f54413248026a00b6affba2d4d58d15c6ae495dc9e99be069c9c314e6a0
SimHash 1110e87c8bb0

Groups

*

Rule Path
Disallow /tag/
Disallow */ubcheckout/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow /poll/
Disallow */sendfriend/
Disallow */ubuywishlist/
Disallow */customer/account/
Disallow */ubuycom/pages
Disallow */webpool/
Disallow */ubcommon/
Disallow */wp-login.php
Disallow */storeswap
Disallow */ubpay/
Disallow */update-store
Disallow */sales/order/
Disallow */rest-apps/
Disallow */curated-store/
Disallow */am/followup/
Disallow */xmlrpc.php
Disallow /*?SID=
Disallow *?cf=cf
Disallow *%26cf%3Dcf
Disallow *?sort_by=
Disallow *%26sort_by%3D
Disallow *?store=
Disallow *%26store%3D
Disallow *?node_id=
Disallow *%26node_id%3D
Disallow *?q=
Disallow *%26q%3D
Disallow *?ref=
Disallow *%26ref%3D
Disallow *?inf=
Disallow *%26inf%3D
Disallow *ref%3Dshop
Disallow *%26sort%3D
Disallow *?price_range=
Disallow *?brand=
Disallow *load-change-country
Disallow *?preview=true
Disallow /html-sitemap/ubuybrands
Disallow */amp/*

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /blogs/cgi-bin/
Disallow /blogs/Hot-Deals/
Disallow /blogs/?s=
Disallow /blogs/tag/
Disallow /blogs/feed/

Other Records

Field Value
sitemap https://www.a.ubuy.com.kw/sitemap.xml
sitemap https://www.a.ubuy.com.kw/blogs/sitemap_kw.xml

Comments

  • Paths (clean URLs)
  • Disallow: */.well-known/
  • Paths (no clean URLs)