sfr.fr
robots.txt

Robots Exclusion Standard data for sfr.fr

Resource Scan

Scan Details

Site Domain sfr.fr
Base Domain sfr.fr
Scan Status Ok
Last Scan2024-06-15T15:43:33+00:00
Next Scan 2024-06-22T15:43:33+00:00

Last Scan

Scanned2024-06-15T15:43:33+00:00
URL https://sfr.fr/robots.txt
Redirect https://www.sfr.fr/robots.txt
Redirect Domain www.sfr.fr
Redirect Base sfr.fr
Domain IPs 80.125.163.172
Redirect IPs 80.125.163.172
Response IP 80.125.163.172
Found Yes
Hash 5b75a9e46d9f21a978387c212d8572ba4e31149fa80cdbe3fded3c5dff9ddadf
SimHash 901894188b26

Groups

ubicrawler
doc
zao
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
larbin
libwww
zyborg
download ninja
wget
grub-client
k2spider
npbot
webreaper
aboundexbot
aboundex/0.2

Rule Path
Disallow /

*

Rule Path
Disallow /v2/
Disallow /recherche/
Disallow /etag/
Disallow /eTagP
Disallow /*?eT
Disallow /*%26eT
Allow /*eTsdi%3D1
Disallow /arrow/
Disallow /authent/
Disallow /cmt/
Disallow /do/authent/
Disallow /indispo/amf.html
Disallow /mobile*ajaxPreview
Disallow /mobile*print%3D
Disallow /*accessoire%3D
Disallow /*btoOffersPage
Disallow /*fonction%3D
Disallow /*gammeNaturalRefName%3D
Disallow /*jsessionid
Disallow /*mobileNaturalRefName%3D
Disallow /*pm%3D
Disallow /*promotionOffreVue
Disallow /*recapitulatif
Disallow /*rmFilter%3D
Disallow /*sendToAFriend.action
Disallow /*sendToFriend.htm
Disallow /*tduid
Disallow /*toOffersPage
Disallow /*topsfr
Disallow /*.jsp$
Disallow /*.jspe$
Disallow /forfait-mobile/telephones/carte-prepayee
Disallow /errors/
Disallow /terminer-ma-commande/
Disallow /forfait-mobile-pro/telephones/forfait-mobile
Disallow /accessoires/cart/*
Disallow /*eTnoCache*
Disallow /options/gen8
Disallow /offre-internet/sfr-box4G
Disallow /tv-sfr/rmc-sport-seng
Disallow /options/cloud1to-mobile-sfr
Disallow /tv-sfr/plus-sport-seng
Disallow /tv-sfr/netflix-4-ecrans
Disallow /parcours/create-mail/create/index.html
Disallow /parcours/internaute/creationCompteInternaute/init.html
Disallow /reseau/carte-couverture-previsionnelle-reseau-mobile
Disallow /avis-marque-sfr/?page=
Allow /avis-marque-sfr/?page=2$
Allow /avis-marque-sfr/?page=3$
Allow /avis-marque-sfr/?page=4$
Allow /avis-marque-sfr/?page=5$
Allow /avis-marque-sfr/?page=6$
Allow /avis-marque-sfr/?page=7$
Allow /avis-marque-sfr/?page=8$
Allow /avis-marque-sfr/?page=9$
Allow /avis-marque-sfr/?page=10$

Other Records

Field Value
sitemap https://www.sfr.fr/sitemap.xml