bidorbuy.co.za
robots.txt

Robots Exclusion Standard data for bidorbuy.co.za

Resource Scan

Scan Details

Site Domain bidorbuy.co.za
Base Domain bidorbuy.co.za
Scan Status Ok
Last Scan2024-09-27T07:22:50+00:00
Next Scan 2024-10-04T07:22:50+00:00

Last Scan

Scanned2024-09-27T07:22:50+00:00
URL https://bidorbuy.co.za/robots.txt
Redirect https://www.bobshop.co.za:443/robots.txt
Redirect Domain www.bobshop.co.za
Redirect Base bobshop.co.za
Domain IPs 13.247.121.136, 13.247.148.235
Redirect IPs 13.246.184.193, 13.247.15.233
Response IP 13.246.184.193
Found Yes
Hash 1b1b295b0ce3f7c32571c79b3f1b288a3495e91ea4bc742a085cfe67461bbc7b
SimHash a811271a4ce9

Groups

rogerbot

Rule Path
Disallow /

*

Rule Path
Disallow /blog/
Disallow /*X_Rated_Adult_Material
Disallow /billing/
Disallow /jsp/buyer/
Disallow /jsp/cart/
Disallow /jsp/fee/
Disallow /jsp/header/
Disallow /jsp/my/
Disallow /jsp/order/
Disallow /jsp/paymentoption/
Disallow /jsp/promo/
Disallow /jsp/question/
Disallow /jsp/Referral.jsp
Disallow /jsp/registration/
Disallow /jsp/seller/
Disallow /jsp/tradelist/filterdialog/
Disallow /jsp/tradesearch/SavedTradeSearchList.jsp
Disallow /jsp/tradesearch/UserAliasCheckAJAXHandler.jsp
Disallow /https
Disallow /services/
Disallow /mobile/jsp/bid/
Disallow /mobilejquery/jsp/bid/
Disallow /mobilejquery/jsp/buyer/
Disallow /mobilejquery/jsp/cart/
Disallow /mobilejquery/jsp/category/
Disallow /mobilejquery/jsp/error/
Disallow /mobilejquery/jsp/item/
Disallow /mobilejquery/jsp/item/includes/
Disallow /mobilejquery/jsp/login/
Disallow /mobilejquery/jsp/offer/
Disallow /mobilejquery/jsp/order/
Disallow /mobilejquery/jsp/payment/
Disallow /mobilejquery/jsp/question/
Disallow /mobilejquery/jsp/registration/
Disallow /mobilejquery/jsp/tradelist/commonfilterincludes/
Disallow /mobilejquery/jsp/seller/
Disallow /mobilejquery/jsp/user/
Disallow /mobilejquery/jsp/userprofile/
Disallow /mobilejquery/jsp/voucher/

Other Records

Field Value
sitemap https://www.bobshop.co.za/static/xml/sitemap/SiteMapIndex.xml

Comments

  • ____ _ _____ _
  • | _ \ | | / ____| |
  • | |_) | ___ | |__ | (___ | |__ ___ _ __
  • | _ < / _ \| '_ \ \___ \| '_ \ / _ \| '_ \
  • | |_) | (_) | |_) | ____) | | | | (_) | |_) |
  • |____/ \___/|_.__/ |_____/|_| |_|\___/| .__/
  • | |
  • |_|
  • If you're reading this, you're probably not a robot. In that case, hello and thanks for visiting Bob Shop! - If you're a robot and you understand this, we welcome our new sentient overlords.
  • At Bob Group we are always looking for brilliant people and since you are reading this, you will fit right in and if you are skilled in Linux, Go, React, Java,
  • get in touch - you will know how to find us ;-)
  • The use of robots or other automated means to access the Bob Shop site without the express permission of Bob Group (Pty) Ltd is strictly prohibited.
  • Notwithstanding the foregoing, Bob Group (Pty) Ltd permit automated access to certain pages but soley for the limited purpose of including content in
  • publicly available search engine, this excludes websites/web services/mobile/publications that could be considered as a marketplace.
  • Any other use of robots, automated means of data capture or failure to obey the robots exclusion standards set
  • forth at <http://www.robotstxt.org/ wc/ exclusion.html> is strictly prohibited.

Warnings

  • `noindex` is not a known field.