m.marketplace.asos.com
robots.txt
Robots Exclusion Standard data for m.marketplace.asos.com
Resource Scan
Scan Details
Site Domain | m.marketplace.asos.com |
Base Domain | asos.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2025-05-16T16:44:27+00:00 |
Next Scan | 2025-06-15T16:44:27+00:00 |
Last Successful Scan
Scanned | 2025-03-25T16:02:48+00:00 |
URL | https://m.marketplace.asos.com/robots.txt |
Domain IPs | 23.52.171.217, 23.52.171.233, 23.59.168.169, 2600:1413:b000:1d::17d1:2e9e, 2600:1413:b000:1d::17d1:2ea3 |
Response IP | 23.52.171.235 |
Found | Yes |
Hash | f41acadbfe1811ea03591ff7ed6c5848fce815bb55f75484db29942a5dcf1a83 |
SimHash | 751526b3c572 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /search/by/ |
Disallow | /account/registration |
Disallow | /my/profile |
Disallow | /my/want-list |
Disallow | /my/activity |
Disallow | /my/orders/ |
Disallow | /my/messages/ |
Disallow | /my/messages/ |
Disallow | /my/feedback/ |
Disallow | /my/listings/ |
Disallow | /checkout/delivery-details |
Disallow | /checkout/order-confirmation |
Disallow | /error |
Disallow | /my/product/edit |
Disallow | /my/product/delete |
Disallow | /authentication/forgotpassword |
Disallow | /Basket/FacebookRegister |
Disallow | /Basket/LogOn |
Disallow | /Basket/Register |
Disallow | /my/boutiqueapplication/complete |
Disallow | /my/cancellation/cancelsellerAccount |
Disallow | /my/cancellation/cancelBuyerAccount |
Disallow | /my/cancellation/cancelSubscription |
Disallow | /help/google-plus |
Other Records
Field | Value |
---|---|
sitemap | https://marketplace.asos.com/feeds/sitemap_index.xml |
Warnings
- 2 invalid lines.