velopressecollection.ouest-france.fr
robots.txt
Robots Exclusion Standard data for velopressecollection.ouest-france.fr
Resource Scan
Scan Details
| Site Domain | velopressecollection.ouest-france.fr |
| Base Domain | ouest-france.fr |
| Scan Status | Ok |
| Last Scan | 2024-10-19T11:06:52+00:00 |
| Next Scan | 2024-11-18T11:06:52+00:00 |
Last Scan
| Scanned | 2024-10-19T11:06:52+00:00 |
| URL | https://velopressecollection.ouest-france.fr/robots.txt |
| Domain IPs | 54.36.220.21 |
| Response IP | 54.36.220.21 |
| Found | Yes |
| Hash | e4aa938911a4876a4fb4e0be8c37fb8d05fdb6b3ba8cbdbe3264887ab11783dc |
| SimHash | 4cdecd6636d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*account.html |
| Disallow | /*clickAd-* |
| Disallow | /*getpagecontent* |
| Disallow | /*login* |
| Disallow | /*logout* |
| Disallow | /*newsletters.html |
| Disallow | /*password.html |
| Disallow | /*rechercher.html |
| Disallow | /*subscribe.html |
| Disallow | /*imagezoom* |
| Disallow | /action-* |
| Disallow | /content/* |
| Disallow | /mon-compte/* |
| Disallow | /mon-panier/* |
| Disallow | /*addtocart* |
| Disallow | /*update_box_cart* |
| Disallow | /*viewcart* |
| Disallow | /*update_product_price* |
| Disallow | /newsletter/* |
| Disallow | /page-introuvable/ |
| Disallow | /recherche/* |
| Disallow | /m/* |
| Disallow | /mobile/* |
| Disallow | /*Benchmark* |
| Disallow | /*index.php* |
| Disallow | /*events_search_init* |
ahrefsbot
baiduspider
barkrowler
bidswitchbot/1.0
blexbot
bubing
catchbot
cfnetwork
cliqzbot
coccocbot-web
digincore
domaincrawler
domaincrawler/3.0
dotbot
duppies
exalead
exaleadcloudview
exensa-dew
faviconizer
garlik
garlikcrawler
grapeshot
iccrawler - icjobs
linkdexbot
linkdexbot/2.0
linkdexbot/2.2
linkpadbot
mail.ru
megaindex
melodibot
mj12bot
obot
panscient.com
proximic
python-urllib
r6_feedfetcher
r6_commentreader
root/0.1
semrushbot
semrushbot-sa
seznambot
sistrix
smtbot
sogou spider
spbot
spinn3r
titan
turnitinbot
turnitinbot
twengabot-2.0
ucrawler/1.0
ucrawler
uptimebot
wotbox
yak/1.0
yandex
yisouspider
zend_http_client
zoombot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://velopressecollection.ouest-france.fr/sitemap-1-google.xml |
Comments