templeandwebster.com.au
robots.txt
Robots Exclusion Standard data for templeandwebster.com.au
Resource Scan
Scan Details
Site Domain | templeandwebster.com.au |
Base Domain | templeandwebster.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-30T19:07:55+00:00 |
Next Scan | 2024-06-13T19:07:55+00:00 |
Last Successful Scan
Scanned | 2022-12-14T01:32:32+00:00 |
URL | https://templeandwebster.com.au/robots.txt |
Redirect | https://www.templeandwebster.com.au/robots.txt |
Redirect Domain | www.templeandwebster.com.au |
Redirect Base | templeandwebster.com.au |
Domain IPs | 96.17.96.26, 96.17.96.30 |
Redirect IPs | 96.17.96.26, 96.17.96.30 |
Response IP | 96.17.96.30 |
Found | Yes |
Hash | 69fc53ea96cc475046efcd8f643678420fb86ea29c96fa895a912151afb63c70 |
SimHash | 8b50086d2753 |
Groups
*
Rule | Path |
---|---|
Allow | /daily-sales/$ |
Disallow | /keyword.php |
Disallow | /v/keyword/search |
Allow | /session/secure/account/trade_program.php |
Disallow | /site_map.php |
Disallow | /a/account/tracking/referrer |
Disallow | /ajax/ |
Disallow | /asp/ |
Disallow | */filter/* |
Disallow | */filters/* |
Disallow | /imgview/ |
Disallow | /logodownload.php |
Disallow | /popups/ |
Disallow | /session/ |
Disallow | /shop/ |
Disallow | /Shop-The-Look/filters/ |
Allow | /v/account/giftcards/purchase |
Disallow | /v/account/ |
Disallow | /blog/wp-content/ |
Disallow | /customerservice/ |
Disallow | /help/answer/ |
Disallow | /param.xml |
Disallow | /return_sales_items.php |
Disallow | /*?filter |
Disallow | /swatch/thing.php |
Disallow | /Staples/ |
Disallow | /v/category/show |
Disallow | /b/batch |
Disallow | /gateway.php |
Disallow | /help/ |
Disallow | /pixel/%21crd_prm%21.gif |
Disallow | /set_location.php |
Disallow | /v/inspiration_gallery/photo_products |
Disallow | /v/inventory/load |
Disallow | /v/product_image_group/get_images |
Disallow | /v/checkout/ |
Disallow | /v/product/review/create |
Disallow | /v/category/get_top_level_categories |
Disallow | /room-ideas/*/style%2Cstyle* |
Disallow | /room-ideas/*/space%2Cspace* |