ubuy.com.bh
robots.txt

Robots Exclusion Standard data for ubuy.com.bh

Resource Scan

Scan Details

Site Domain ubuy.com.bh
Base Domain ubuy.com.bh
Scan Status Ok
Last Scan2024-05-25T08:39:46+00:00
Next Scan 2024-06-01T08:39:46+00:00

Last Scan

Scanned2024-05-25T08:39:46+00:00
URL https://www.ubuy.com.bh/robots.txt
Domain IPs 108.156.133.107, 108.156.133.16, 108.156.133.64, 108.156.133.92
Response IP 108.156.133.107
Found Yes
Hash a5849e85de50977d0dd6d9941fb1ec0c25619f23f0edf0cd9acf7c864b64f09e
SimHash 2434597489e7

Groups

*

Rule Path
Disallow /tag/
Disallow /ubcheckout/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /sendfriend/
Disallow /ubuywishlist/
Disallow */ubuycom/*
Disallow */webpool/*
Disallow */ubpay/*
Disallow /search/?
Disallow /wp-login.php
Disallow /storeswap
Disallow /update-store
Disallow /sales/order/
Disallow /curated-store/
Disallow /am/followup/
Disallow /xmlrpc.php
Disallow *?SID=*
Disallow *?cf=cf*
Disallow *%26cf%3Dcf*
Disallow *?sort_by=*
Disallow *%26sort_by%3D*
Disallow *?store=*
Disallow *%26store%3D*
Disallow *?node_id=*
Disallow *%26node_id%3D*
Disallow *%26q%3D*
Disallow *%26sort%3D*
Disallow *?price_range=*
Disallow *?brand=*
Disallow *load-change-country*
Disallow *?preview=true*
Disallow *?q=*
Disallow */?q=*
Disallow *?ref=*
Disallow *%26ref%3D*
Disallow *?inf=*
Disallow *%26inf%3D*
Disallow *ref%3Dshop*
Disallow */ubcommon/*
Disallow */rest-apps/*
Disallow */.well-known/
Disallow */skin/*
Disallow */amorder/*
Disallow *?substore=store*
Disallow */contacts/index/
Disallow *?shortlink=*
Disallow */index.php/*
Disallow /blogs/cgi-bin/
Disallow /blogs/Hot-Deals/
Disallow /blogs/?s=
Disallow /blogs/tag/
Disallow /blogs/feed/

gptbot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ubuy.com.bh/sitemap.xml

Comments

  • Disallow specific paths
  • Disallow query string parameters
  • Disallow: */productimg/*
  • Disallow: */productimage/*
  • Disallow specific blog paths
  • Allow sitemap
  • User-agent specific rules