rs-online.com
robots.txt
Robots Exclusion Standard data for rs-online.com
Resource Scan
Scan Details
Site Domain | rs-online.com |
Base Domain | rs-online.com |
Scan Status | Ok |
Last Scan | 2024-10-10T15:06:49+00:00 |
Next Scan | 2024-11-09T15:06:49+00:00 |
Last Scan
Scanned | 2024-10-10T15:06:49+00:00 |
URL | https://www.rs-online.com/robots.txt |
Domain IPs | 23.203.77.137 |
Response IP | 60.254.169.140 |
Found | Yes |
Hash | 21ed31c2468acf11160e4bf7511a5126812eb5992886e74f45c0d157ec58a5d7 |
SimHash | ebd50939fea2 |
Groups
*
Rule | Path |
---|---|
Disallow | /offline |
Disallow | /web/cart/ |
Disallow | /web/orderoptions/ |
Disallow | /web/register/registration |
Disallow | /web/feedback.html |
Disallow | /web/orderhistory.html |
Disallow | /cgi-bin/ |
Disallow | /web/ca/ |
Disallow | /web/ma/ |
Disallow | /web/cp* |
Disallow | /web/template/ |
Disallow | /web/docs/ |
Disallow | /web/auth/ |
Disallow | /web/lc/ |
Disallow | /web/miniBasketRunningTotal.html |
Disallow | /web/services/header/getDynamicData |
Disallow | /pm/* |
Disallow | /myaccount/ |
Disallow | /basket |
Disallow | /*login |
Disallow | /*%26cid* |
Disallow | /*searchTerm%3D* |
Disallow | /*?searchType=* |
Disallow | /*?viewMode=* |
Disallow | /*?sra=* |
Disallow | /*%26rpp%3D* |
Disallow | /*?Nr* |
Disallow | /*?mpn=* |
Disallow | /*?esid=* |
Disallow | /*?brandShopPath=* |
Disallow | /*lastAttributeSelectedBlock%3D* |
Disallow | /*%26vn%3D* |
Disallow | /*?vn=* |
Disallow | /*?N=* |
Disallow | /*?BV_SessionID=* |
Disallow | /web/web/* |
Disallow | /*?page-offset=* |
Disallow | /*faq/faq* |
Disallow | /*?method=* |
Disallow | /*%26method%3D* |
Disallow | /*%26sort-by%3D* |
Disallow | /mobile/basket* |
Disallow | /mobile/emptyBasket* |
Disallow | /mobile/co/ |
Disallow | /mobile/services/ |
Disallow | /mobile/guestLogin* |
Disallow | /mobile/register/ |
Disallow | /mobile/secure/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.rs-online.com/sitemap.xml |
Comments