spreadshirt.dk
robots.txt
Robots Exclusion Standard data for spreadshirt.dk
Resource Scan
Scan Details
| Site Domain | spreadshirt.dk |
| Base Domain | spreadshirt.dk |
| Scan Status | Ok |
| Last Scan | 2024-05-20T20:48:17+00:00 |
| Next Scan | 2024-06-03T20:48:17+00:00 |
Last Scan
| Scanned | 2024-05-20T20:48:17+00:00 |
| URL | https://spreadshirt.dk/robots.txt |
| Redirect | https://www.spreadshirt.dk/robots.txt |
| Redirect Domain | www.spreadshirt.dk |
| Redirect Base | spreadshirt.dk |
| Domain IPs | 151.101.130.137, 151.101.194.137, 151.101.2.137, 151.101.66.137, 2a04:4e42:200::649, 2a04:4e42:400::649, 2a04:4e42:600::649, 2a04:4e42::649 |
| Redirect IPs | 151.101.130.137, 151.101.194.137, 151.101.2.137, 151.101.66.137, 2a04:4e42:200::649, 2a04:4e42:400::649, 2a04:4e42:600::649, 2a04:4e42::649 |
| Response IP | 199.232.46.137 |
| Found | Yes |
| Hash | e9b52107765af48ca6743265722eaf89d6fade5a35a4f848bb9a68386be502ba |
| SimHash | 9048c964779b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */cookie-hint* |
| Disallow | /api/v1/users/current |
| Disallow | /bims/ |
| Disallow | /forum/assets/ |
| Disallow | /forum/auth/ |
| Disallow | /forum/badges/ |
| Disallow | /forum/search |
| Disallow | /forum/users/ |
| Disallow | /image-server/ |
| Disallow | /log/ |
| Disallow | /Public/esi/ |
| Disallow | /resources/cookie/ |
| Disallow | /resources/fonts/ |
| Disallow | /shop/*.pdf$ |
| Disallow | /shop/*.svg$ |
| Disallow | /shopData/authentication |
| Disallow | /shopData/basket |
| Disallow | /shopData/recommended |
| Disallow | /shopData/related |
| Disallow | /shopData/wellness |
| Disallow | /shopfiles/shopclient/remote_logging |
| Disallow | /users/ |
| Disallow | *?abTest= |
| Disallow | *%26abTest%3D |
| Disallow | *?noCache= |
| Disallow | *%26noCache%3D |
| Disallow | *?version= |
| Disallow | *%26version%3D |
| Disallow | *?feature= |
| Disallow | *%26feature%3D |
| Disallow | *?q= |
| Disallow | *%26q%3D |
| Disallow | *?sort= |
| Disallow | *%26sort%3D |
| Disallow | /shop/*%26brand%3D |
| Disallow | /shop/*%26color%3D |
| Disallow | /shop/*%26designstyle%3D |
| Disallow | /shop/*%26finish%3D |
| Disallow | /shop/*%26fit%3D |
| Disallow | /shop/*%26material%3D |
| Disallow | /shop/*%26neckline%3D |
| Disallow | /shop/*%26page%3D |
| Disallow | /shop/*%26price%3D |
| Disallow | /shop/*%26quantity%3D |
| Disallow | /shop/*%26safesearch%3D |
| Disallow | /shop/*%26sleeve%3D |
| Disallow | /shop/*%26style%3D |
| Disallow | /shop/*%26sustainability%3D |
| Disallow | /shop/*?brand= |
| Disallow | /shop/*?color= |
| Disallow | /shop/*?designstyle= |
| Disallow | /shop/*?finish= |
| Disallow | /shop/*?fit= |
| Disallow | /shop/*?material= |
| Disallow | /shop/*?neckline= |
| Disallow | /shop/*?page= |
| Disallow | /shop/*?price= |
| Disallow | /shop/*?quantity= |
| Disallow | /shop/*?safesearch= |
| Disallow | /shop/*?sleeve= |
| Disallow | /shop/*?style= |
| Disallow | /shop/*?sustainability= |
| Allow | /shopData/reviews |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.spreadshirt.dk/sitemaps/sitemap.xml |