velopressecollection.fr
robots.txt

Robots Exclusion Standard data for velopressecollection.fr

Resource Scan

Scan Details

Site Domain velopressecollection.fr
Base Domain velopressecollection.fr
Scan Status Ok
Last Scan2024-11-15T22:08:33+00:00
Next Scan 2024-12-15T22:08:33+00:00

Last Scan

Scanned2024-11-15T22:08:33+00:00
URL https://www.velopressecollection.fr/robots.txt
Redirect https://velopressecollection.ouest-france.fr/robots.txt
Redirect Domain velopressecollection.ouest-france.fr
Redirect Base ouest-france.fr
Domain IPs 23.215.7.6, 23.215.7.7, 2600:1413:b000:1b::17d7:706, 2600:1413:b000:1b::17d7:707
Redirect IPs 54.36.220.21
Response IP 54.36.220.21
Found Yes
Hash e4aa938911a4876a4fb4e0be8c37fb8d05fdb6b3ba8cbdbe3264887ab11783dc
SimHash 4cdecd6636d1

Groups

*

Rule Path
Disallow /*account.html
Disallow /*clickAd-*
Disallow /*getpagecontent*
Disallow /*login*
Disallow /*logout*
Disallow /*newsletters.html
Disallow /*password.html
Disallow /*rechercher.html
Disallow /*subscribe.html
Disallow /*imagezoom*
Disallow /action-*
Disallow /content/*
Disallow /mon-compte/*
Disallow /mon-panier/*
Disallow /*addtocart*
Disallow /*update_box_cart*
Disallow /*viewcart*
Disallow /*update_product_price*
Disallow /newsletter/*
Disallow /page-introuvable/
Disallow /recherche/*
Disallow /m/*
Disallow /mobile/*
Disallow /*Benchmark*
Disallow /*index.php*
Disallow /*events_search_init*

ahrefsbot
baiduspider
barkrowler
bidswitchbot/1.0
blexbot
bubing
catchbot
cfnetwork
cliqzbot
coccocbot-web
digincore
domaincrawler
domaincrawler/3.0
dotbot
duppies
exalead
exaleadcloudview
exensa-dew
faviconizer
garlik
garlikcrawler
grapeshot
iccrawler - icjobs
linkdexbot
linkdexbot/2.0
linkdexbot/2.2
linkpadbot
mail.ru
megaindex
melodibot
mj12bot
obot
panscient.com
proximic
python-urllib
r6_feedfetcher
r6_commentreader
root/0.1
semrushbot
semrushbot-sa
seznambot
sistrix
smtbot
sogou spider
spbot
spinn3r
titan
turnitinbot
turnitinbot
twengabot-2.0
ucrawler/1.0
ucrawler
uptimebot
wotbox
yak/1.0
yandex
yisouspider
zend_http_client
zoombot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://velopressecollection.ouest-france.fr/sitemap-1-google.xml

Comments

  • evenement---------------------------
  • commentaire------------------------
  • Disallow: /*addacomment*
  • tri--------------------------------
  • Disallow: /*sort_value*
  • Disallow: /*sort_way*
  • Disallow: /*fillform*
  • filtre-----------------------------
  • Disallow: /*filtre=*
  • annuaire---------------------------
  • Disallow: /*recherch.html
  • Disallow: /*recherche-last.html
  • Disallow: /*recherche-advanced-last.html
  • robots interdits