bobshop.co.za
robots.txt
Robots Exclusion Standard data for bobshop.co.za
Resource Scan
Scan Details
Site Domain | bobshop.co.za |
Base Domain | bobshop.co.za |
Scan Status | Ok |
Last Scan | 2024-10-09T14:51:09+00:00 |
Next Scan | 2024-10-16T14:51:09+00:00 |
Last Scan
Scanned | 2024-10-09T14:51:09+00:00 |
URL | https://bobshop.co.za/robots.txt |
Redirect | https://www.bobshop.co.za/robots.txt |
Redirect Domain | www.bobshop.co.za |
Redirect Base | bobshop.co.za |
Domain IPs | 13.245.103.189, 13.245.210.155 |
Redirect IPs | 13.245.103.189, 13.245.210.155 |
Response IP | 13.245.103.189 |
Found | Yes |
Hash | 1b1b295b0ce3f7c32571c79b3f1b288a3495e91ea4bc742a085cfe67461bbc7b |
SimHash | a811271a4ce9 |
Groups
*
Rule | Path |
---|---|
Disallow | /blog/ |
Disallow | /*X_Rated_Adult_Material |
Disallow | /billing/ |
Disallow | /jsp/buyer/ |
Disallow | /jsp/cart/ |
Disallow | /jsp/fee/ |
Disallow | /jsp/header/ |
Disallow | /jsp/my/ |
Disallow | /jsp/order/ |
Disallow | /jsp/paymentoption/ |
Disallow | /jsp/promo/ |
Disallow | /jsp/question/ |
Disallow | /jsp/Referral.jsp |
Disallow | /jsp/registration/ |
Disallow | /jsp/seller/ |
Disallow | /jsp/tradelist/filterdialog/ |
Disallow | /jsp/tradesearch/SavedTradeSearchList.jsp |
Disallow | /jsp/tradesearch/UserAliasCheckAJAXHandler.jsp |
Disallow | /https |
Disallow | /services/ |
Disallow | /mobile/jsp/bid/ |
Disallow | /mobilejquery/jsp/bid/ |
Disallow | /mobilejquery/jsp/buyer/ |
Disallow | /mobilejquery/jsp/cart/ |
Disallow | /mobilejquery/jsp/category/ |
Disallow | /mobilejquery/jsp/error/ |
Disallow | /mobilejquery/jsp/item/ |
Disallow | /mobilejquery/jsp/item/includes/ |
Disallow | /mobilejquery/jsp/login/ |
Disallow | /mobilejquery/jsp/offer/ |
Disallow | /mobilejquery/jsp/order/ |
Disallow | /mobilejquery/jsp/payment/ |
Disallow | /mobilejquery/jsp/question/ |
Disallow | /mobilejquery/jsp/registration/ |
Disallow | /mobilejquery/jsp/tradelist/commonfilterincludes/ |
Disallow | /mobilejquery/jsp/seller/ |
Disallow | /mobilejquery/jsp/user/ |
Disallow | /mobilejquery/jsp/userprofile/ |
Disallow | /mobilejquery/jsp/voucher/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.bobshop.co.za/static/xml/sitemap/SiteMapIndex.xml |
Warnings
- `noindex` is not a known field.
Comments