sportsdirect.fr
robots.txt

Robots Exclusion Standard data for sportsdirect.fr

Resource Scan

Scan Details

Site Domain sportsdirect.fr
Base Domain sportsdirect.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-06T01:26:22+00:00
Next Scan 2024-07-06T01:26:22+00:00

Last Successful Scan

Scanned2024-04-15T00:04:39+00:00
URL https://sportsdirect.fr/robots.txt
Redirect https://www.sportsdirect.fr/robots.txt
Redirect Domain www.sportsdirect.fr
Redirect Base sportsdirect.fr
Domain IPs 23.59.168.129, 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bd4
Redirect IPs 23.209.46.149, 23.209.46.156, 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bd4
Response IP 23.59.168.129
Found Yes
Hash 380a1e89151efee5b6ad588d51fcab9db7301f1c0927b4ef2993eb33672a3e27
SimHash 095d5930ccc2

Groups

*

Rule Path
Disallow /au/
Disallow /ch/
Disallow /cn/
Disallow /es/
Disallow /it/
Disallow /jp/
Disallow /us/
Disallow /eu/
Disallow /gb/
Disallow /hk/
Disallow /cart
Disallow /checkout
Disallow /search
Disallow /wishlist
Disallow /api/*
Disallow /product-*
Disallow /404
Disallow /account
Disallow /favicons
Disallow /fonts
Disallow /icons
Disallow /locales
Disallow /sizeguide
Disallow /pages/*
Disallow /*?webgender
Disallow /*%26webgender
Disallow /*%26webbrand
Disallow /*?webbrand
Disallow /*?cleancolour
Disallow /*%26cleancolour
Disallow /*?cleansize
Disallow /*%26cleansize
Disallow /*?sellingprice
Disallow /*%26sellingprice
Disallow /*colcode
Disallow /*?colcode
Disallow /*?sort
Disallow /*%26sort
Disallow /*promo_name
Disallow /*subcategorygroup
Disallow /User/
Disallow /user/
Disallow /Login/
Disallow /Login
Disallow /login
Disallow /SaveForLater.aspx
Disallow /customerservices/safesender.aspx
Disallow /saveforlater.aspx
Disallow /Profile/
Disallow /profile/
Disallow /Skins/
Disallow /skins/
Disallow /Widgets/
Disallow /widgets/
Disallow /updatepassword
Disallow /passwordupdaterequest
Disallow /accountinformation
Disallow /recognition
Disallow */ctl/logoff
Disallow /registration*
Disallow /account/
Disallow /Account/
Disallow /graphql

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sportsdirect.fr/sitemap.xml
sitemap https://www.sportsdirect.fr/sitemap/content.xml