sportsdirect.fr
robots.txt
Robots Exclusion Standard data for sportsdirect.fr
Resource Scan
Scan Details
| Site Domain | sportsdirect.fr |
| Base Domain | sportsdirect.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-04T01:37:24+00:00 |
| Next Scan | 2024-12-03T01:37:24+00:00 |
Last Successful Scan
| Scanned | 2024-04-15T00:04:39+00:00 |
| URL | https://sportsdirect.fr/robots.txt |
| Redirect | https://www.sportsdirect.fr/robots.txt |
| Redirect Domain | www.sportsdirect.fr |
| Redirect Base | sportsdirect.fr |
| Domain IPs | 23.59.168.129, 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bd4 |
| Redirect IPs | 23.209.46.149, 23.209.46.156, 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bd4 |
| Response IP | 23.59.168.129 |
| Found | Yes |
| Hash | 380a1e89151efee5b6ad588d51fcab9db7301f1c0927b4ef2993eb33672a3e27 |
| SimHash | 095d5930ccc2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /au/ |
| Disallow | /ch/ |
| Disallow | /cn/ |
| Disallow | /es/ |
| Disallow | /it/ |
| Disallow | /jp/ |
| Disallow | /us/ |
| Disallow | /eu/ |
| Disallow | /gb/ |
| Disallow | /hk/ |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /search |
| Disallow | /wishlist |
| Disallow | /api/* |
| Disallow | /product-* |
| Disallow | /404 |
| Disallow | /account |
| Disallow | /favicons |
| Disallow | /fonts |
| Disallow | /icons |
| Disallow | /locales |
| Disallow | /sizeguide |
| Disallow | /pages/* |
| Disallow | /*?webgender |
| Disallow | /*%26webgender |
| Disallow | /*%26webbrand |
| Disallow | /*?webbrand |
| Disallow | /*?cleancolour |
| Disallow | /*%26cleancolour |
| Disallow | /*?cleansize |
| Disallow | /*%26cleansize |
| Disallow | /*?sellingprice |
| Disallow | /*%26sellingprice |
| Disallow | /*colcode |
| Disallow | /*?colcode |
| Disallow | /*?sort |
| Disallow | /*%26sort |
| Disallow | /*promo_name |
| Disallow | /*subcategorygroup |
| Disallow | /User/ |
| Disallow | /user/ |
| Disallow | /Login/ |
| Disallow | /Login |
| Disallow | /login |
| Disallow | /SaveForLater.aspx |
| Disallow | /customerservices/safesender.aspx |
| Disallow | /saveforlater.aspx |
| Disallow | /Profile/ |
| Disallow | /profile/ |
| Disallow | /Skins/ |
| Disallow | /skins/ |
| Disallow | /Widgets/ |
| Disallow | /widgets/ |
| Disallow | /updatepassword |
| Disallow | /passwordupdaterequest |
| Disallow | /accountinformation |
| Disallow | /recognition |
| Disallow | */ctl/logoff |
| Disallow | /registration* |
| Disallow | /account/ |
| Disallow | /Account/ |
| Disallow | /graphql |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sportsdirect.fr/sitemap.xml |
| sitemap | https://www.sportsdirect.fr/sitemap/content.xml |