thebedstore.co.za
robots.txt
Robots Exclusion Standard data for thebedstore.co.za
Resource Scan
Scan Details
| Site Domain | thebedstore.co.za |
| Base Domain | thebedstore.co.za |
| Scan Status | Ok |
| Last Scan | 2024-06-14T08:12:54+00:00 |
| Next Scan | 2024-06-28T08:12:54+00:00 |
Last Scan
| Scanned | 2024-06-14T08:12:54+00:00 |
| URL | https://thebedstore.co.za/robots.txt |
| Domain IPs | 104.26.0.113, 104.26.1.113, 172.67.68.138, 2606:4700:20::681a:171, 2606:4700:20::681a:71, 2606:4700:20::ac43:448a |
| Response IP | 104.26.1.113 |
| Found | Yes |
| Hash | c63b965523348c47982ac02f13301df1f1254c5f2bec7569c40a3a2d9bc16bfa |
| SimHash | 0138fc04c195 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404/ |
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | *mof_data%3D |
| Disallow | /catalog/product/view/ |
| Disallow | *dab_product.* |
| Disallow | *dab_brands.* |
| Disallow | *product_badge.* |
| Disallow | *price%3D.* |
| Disallow | /hidden-category-to-display-widget |
| Disallow | /*?*cat=* |
| Disallow | /*?*dab_brands=* |
| Disallow | /*?*dab_product_badge=* |
| Disallow | /*?*price=* |
| Disallow | /catalog/category/ |
| Disallow | /*?pr_prod_strat |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /404/ |
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | *mof_data%3D |
| Disallow | /catalog/product/view/ |
| Disallow | *dab_product.* |
| Disallow | *dab_brands.* |
| Disallow | *product_badge.* |
| Disallow | *price%3D.* |
| Disallow | /hidden-category-to-display-widget |
| Disallow | /*?*cat=* |
| Disallow | /*?*dab_brands=* |
| Disallow | /*?*dab_product_badge=* |
| Disallow | /*?*price=* |
| Disallow | /catalog/category/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thebedstore.co.za/pub/pub/media/sitemap.xml |