spreadshirt.nl
robots.txt
Robots Exclusion Standard data for spreadshirt.nl
Resource Scan
Scan Details
| Site Domain | spreadshirt.nl |
| Base Domain | spreadshirt.nl |
| Scan Status | Ok |
| Last Scan | 2024-10-07T05:16:40+00:00 |
| Next Scan | 2024-10-21T05:16:40+00:00 |
Last Scan
| Scanned | 2024-10-07T05:16:40+00:00 |
| URL | https://spreadshirt.nl/robots.txt |
| Redirect | https://www.spreadshirt.nl/robots.txt |
| Redirect Domain | www.spreadshirt.nl |
| Redirect Base | spreadshirt.nl |
| Domain IPs | 151.101.130.137, 151.101.194.137, 151.101.2.137, 151.101.66.137, 2a04:4e42:200::649, 2a04:4e42:400::649, 2a04:4e42:600::649, 2a04:4e42::649 |
| Redirect IPs | 151.101.130.137, 151.101.194.137, 151.101.2.137, 151.101.66.137, 2a04:4e42:200::649, 2a04:4e42:400::649, 2a04:4e42:600::649, 2a04:4e42::649 |
| Response IP | 199.232.46.137 |
| Found | Yes |
| Hash | 04f8568c079fc634a11ce47c181c6be5b83f480a4c76fbb3108df002a52e2d66 |
| SimHash | 8348c930479b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */cookie-hint* |
| Disallow | /api/v1/users/current |
| Disallow | /bims/ |
| Disallow | /forum/assets/ |
| Disallow | /forum/auth/ |
| Disallow | /forum/badges/ |
| Disallow | /forum/search |
| Disallow | /forum/users/ |
| Disallow | /image-server/ |
| Disallow | /log/ |
| Disallow | /Public/esi/ |
| Disallow | /resources/cookie/ |
| Disallow | /resources/fonts/ |
| Disallow | /shop/*.pdf$ |
| Disallow | /shop/*.svg$ |
| Disallow | /shopData/authentication |
| Disallow | /shopData/basket |
| Disallow | /shopData/recommended |
| Disallow | /shopData/related |
| Disallow | /shopData/wellness |
| Disallow | /shopfiles/shopclient/remote_logging |
| Disallow | /users/ |
| Disallow | *?abTest= |
| Disallow | *%26abTest%3D |
| Disallow | *?noCache= |
| Disallow | *%26noCache%3D |
| Disallow | *?version= |
| Disallow | *%26version%3D |
| Disallow | *?feature= |
| Disallow | *%26feature%3D |
| Disallow | *?q= |
| Disallow | *%26q%3D |
| Disallow | *?sort= |
| Disallow | *%26sort%3D |
| Disallow | /shop/*%26affiliateId%3D |
| Disallow | /shop/*%26brand%3D |
| Disallow | /shop/*%26color%3D |
| Disallow | /shop/*%26designstyle%3D |
| Disallow | /shop/*%26fbclid%3D |
| Disallow | /shop/*%26finish%3D |
| Disallow | /shop/*%26fit%3D |
| Disallow | /shop/*%26material%3D |
| Disallow | /shop/*%26neckline%3D |
| Disallow | /shop/*%26page%3D |
| Disallow | /shop/*%26price%3D |
| Disallow | /shop/*%26property%3D |
| Disallow | /shop/*%26quantity%3D |
| Disallow | /shop/*%26safesearch%3D |
| Disallow | /shop/*%26sleeve%3D |
| Disallow | /shop/*%26srEdit%3D |
| Disallow | /shop/*%26srsltid%3D |
| Disallow | /shop/*%26style%3D |
| Disallow | /shop/*%26sustainability%3D |
| Disallow | /shop/*%26topic%3D |
| Disallow | /shop/*%26view%3D |
| Disallow | /shop/*?affiliateId= |
| Disallow | /shop/*?brand= |
| Disallow | /shop/*?color= |
| Disallow | /shop/*?designstyle= |
| Disallow | /shop/*?fbclid= |
| Disallow | /shop/*?finish= |
| Disallow | /shop/*?fit= |
| Disallow | /shop/*?material= |
| Disallow | /shop/*?neckline= |
| Disallow | /shop/*?page= |
| Disallow | /shop/*?price= |
| Disallow | /shop/*?property= |
| Disallow | /shop/*?quantity= |
| Disallow | /shop/*?safesearch= |
| Disallow | /shop/*?sleeve= |
| Disallow | /shop/*?srEdit= |
| Disallow | /shop/*?srsltid= |
| Disallow | /shop/*?style= |
| Disallow | /shop/*?sustainability= |
| Disallow | /shop/*?topic= |
| Disallow | /shop/*?view= |
| Allow | /shopData/reviews |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.spreadshirt.nl/sitemaps/sitemap.xml |