theblockshop.com.au
robots.txt
Robots Exclusion Standard data for theblockshop.com.au
Resource Scan
Scan Details
| Site Domain | theblockshop.com.au |
| Base Domain | theblockshop.com.au |
| Scan Status | Ok |
| Last Scan | 2024-07-02T01:56:54+00:00 |
| Next Scan | 2024-07-16T01:56:54+00:00 |
Last Scan
| Scanned | 2024-07-02T01:56:54+00:00 |
| URL | https://theblockshop.com.au/robots.txt |
| Domain IPs | 13.227.254.113, 13.227.254.31, 13.227.254.35, 13.227.254.7 |
| Response IP | 13.227.254.35 |
| Found | Yes |
| Hash | 9e845a1ecf8f4beb11afa6c3dad4a73b48ead2cf9c7a5c16df50fb70f91dbcc2 |
| SimHash | e9149105e793 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /onestepcheckout/ |
| Disallow | /catalogsearch/ |
| Disallow | /newsletter/ |
| Disallow | /sendfriend/ |
| Disallow | /customize/ |
| Disallow | /index.php/ |
| Disallow | /checkout/ |
| Disallow | /wishlist/ |
| Disallow | /contacts/ |
| Disallow | /customer/ |
| Disallow | /review/ |
| Disallow | /ajax/ |
| Disallow | /poll/ |
| Disallow | /tag/ |
| Disallow | *am_on_sale%3D1* |
| Disallow | *on_sale%3D1* |
| Disallow | *?id=* |
| Disallow | /convertcatalog/* |
| Disallow | /instant/* |
| Disallow | *?buyabstract* |
| Disallow | *?%24* |
| Disallow | *?free-ship=* |
| Disallow | *?button=* |
| Disallow | *?brand=* |
| Disallow | *?price=* |
| Disallow | *?tbs_colour_11=* |
| Disallow | *?tbs_material_12=* |
| Disallow | *?tbs_pattern_16=* |
| Disallow | *?tbs_pillow_firmness_265=* |
| Disallow | *?tbs_fill_material_14=* |
| Disallow | *?tbs_colour_66=* |
| Disallow | *?tbs_product_type=* |
| Disallow | /*.php* |
| Disallow | /*?SID=* |
| Disallow | /*?ajax=* |
| Disallow | /*?options=* |
| Disallow | /*?product_list_dir=* |
| Disallow | /*?product_list_mode=* |
| Disallow | /*?product_list_order=* |
| Disallow | /*?product_list_limit=* |
| Disallow | /*couples/rooms/ajaxindex* |
| Disallow | /*?room_type=* |
| Disallow | /*?series=* |
| Disallow | /*couples/rooms/index* |
| Disallow | /*?_bta_tid=* |
| Disallow | /search/go |
Comments