templeandwebster.com.au
robots.txt

Robots Exclusion Standard data for templeandwebster.com.au

Resource Scan

Scan Details

Site Domain templeandwebster.com.au
Base Domain templeandwebster.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-30T19:07:55+00:00
Next Scan 2024-06-13T19:07:55+00:00

Last Successful Scan

Scanned2022-12-14T01:32:32+00:00
URL https://templeandwebster.com.au/robots.txt
Redirect https://www.templeandwebster.com.au/robots.txt
Redirect Domain www.templeandwebster.com.au
Redirect Base templeandwebster.com.au
Domain IPs 96.17.96.26, 96.17.96.30
Redirect IPs 96.17.96.26, 96.17.96.30
Response IP 96.17.96.30
Found Yes
Hash 69fc53ea96cc475046efcd8f643678420fb86ea29c96fa895a912151afb63c70
SimHash 8b50086d2753

Groups

*

Rule Path
Allow /daily-sales/$
Disallow /keyword.php
Disallow /v/keyword/search
Allow /session/secure/account/trade_program.php
Disallow /site_map.php
Disallow /a/account/tracking/referrer
Disallow /ajax/
Disallow /asp/
Disallow */filter/*
Disallow */filters/*
Disallow /imgview/
Disallow /logodownload.php
Disallow /popups/
Disallow /session/
Disallow /shop/
Disallow /Shop-The-Look/filters/
Allow /v/account/giftcards/purchase
Disallow /v/account/
Disallow /blog/wp-content/
Disallow /customerservice/
Disallow /help/answer/
Disallow /param.xml
Disallow /return_sales_items.php
Disallow /*?filter
Disallow /swatch/thing.php
Disallow /Staples/
Disallow /v/category/show
Disallow /b/batch
Disallow /gateway.php
Disallow /help/
Disallow /pixel/%21crd_prm%21.gif
Disallow /set_location.php
Disallow /v/inspiration_gallery/photo_products
Disallow /v/inventory/load
Disallow /v/product_image_group/get_images
Disallow /v/checkout/
Disallow /v/product/review/create
Disallow /v/category/get_top_level_categories
Disallow /room-ideas/*/style%2Cstyle*
Disallow /room-ideas/*/space%2Cspace*