ouest-france.fr
robots.txt
Robots Exclusion Standard data for ouest-france.fr
Resource Scan
Scan Details
| Site Domain | ouest-france.fr |
| Base Domain | ouest-france.fr |
| Scan Status | Ok |
| Last Scan | 2024-11-12T22:11:01+00:00 |
| Next Scan | 2024-11-19T22:11:01+00:00 |
Last Scan
| Scanned | 2024-11-12T22:11:01+00:00 |
| URL | https://www.ouest-france.fr/robots.txt |
| Domain IPs | 23.210.98.16 |
| Response IP | 23.210.98.16 |
| Found | Yes |
| Hash | 807f5e8afc49df0112847731ed00eee28bfc32c1654b68ea6ccdef04e9b417f6 |
| SimHash | 2c7b5095c635 |
Groups
mediapartners-google
googlebot
googlebot-image
googlebot-news
googlebot-video
googleother
adsbot-google
storebot-google
adsbot-google-mobile
apis-google
twitterbot
applebot
ouestfrancebot
taboolabot
proximic
upday
bingbot
exabot
slurp
ia_archiver
grapeshot
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | */mail?id=* |
| Disallow | */newsletters/bundles/* |
| Disallow | */test-de-publication-* |
| Disallow | /*%2525 |
| Disallow | /*%26edition%3D* |
| Disallow | /*%26fbclid%3D* |
| Disallow | /*%26mediego* |
| Disallow | /*%26parution%3D* |
| Disallow | /*?datasport* |
| Disallow | /*?dateCompetition=* |
| Disallow | /*?edition=* |
| Disallow | /*?fbclid=* |
| Disallow | /*?login |
| Disallow | /*?logout |
| Disallow | /*?mediego* |
| Disallow | /*?parution=* |
| Disallow | /admin/ |
| Disallow | /ajax_comment/ |
| Disallow | /balades/ |
| Disallow | /balades? |
| Disallow | /cinema/film/ |
| Disallow | /comment/reply/ |
| Disallow | /communaute/galerie-photo/*/ajout |
| Disallow | /economie/entreprises/centrale-des-marches |
| Disallow | /economie/entreprises/evenements-des-entreprises |
| Disallow | /economie/entreprises/offres-emploi |
| Disallow | /espace-contributions/ |
| Disallow | /espace-debat/utilisateur/ |
| Disallow | /etudiant/job-formation/ |
| Disallow | /examens/ |
| Disallow | /filter/tips/ |
| Disallow | /install.php |
| Disallow | /jeux-olympiques/resultats/*/?* |
| Disallow | /mail?type* |
| Disallow | /obseques/search/ |
| Disallow | /publication-statics/ |
| Disallow | /recherche/ |
| Disallow | /rpc/ |
| Disallow | /scribblelive |
| Disallow | /search/ |
| Disallow | /share/ |
| Disallow | /sport/running/*/calendrier-des-courses/?* |
| Disallow | /update.php |
| Disallow | /user |
| Disallow | /user/ |
| Disallow | /user/login/ |
| Disallow | /user/logout/ |
| Disallow | /user/password/ |
| Disallow | /user/register?* |
| Disallow | /xmlrpc.php |
exabot
slurp
ia_archiver
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ouest-france.fr/sitemap.xml |
| sitemap | https://www.ouest-france.fr/googlenews.xml |
Warnings
- 4 invalid lines.
Comments