ouestfrance.com
robots.txt
Robots Exclusion Standard data for ouestfrance.com
Resource Scan
Scan Details
| Site Domain | ouestfrance.com |
| Base Domain | ouestfrance.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T14:44:03+00:00 |
| Next Scan | 2024-11-27T14:44:03+00:00 |
Last Scan
| Scanned | 2024-10-28T14:44:03+00:00 |
| URL | http://ouestfrance.com/robots.txt |
| Redirect | https://www.ouest-france.fr:443/robots.txt |
| Redirect Domain | www.ouest-france.fr |
| Redirect Base | ouest-france.fr |
| Domain IPs | 217.70.184.38 |
| Redirect IPs | 23.210.98.16 |
| Response IP | 96.7.111.239 |
| Found | Yes |
| Hash | 807f5e8afc49df0112847731ed00eee28bfc32c1654b68ea6ccdef04e9b417f6 |
| SimHash | 2c7b5095c635 |
Groups
mediapartners-google
googlebot
googlebot-image
googlebot-news
googlebot-video
googleother
adsbot-google
storebot-google
adsbot-google-mobile
apis-google
twitterbot
applebot
ouestfrancebot
taboolabot
proximic
upday
bingbot
exabot
slurp
ia_archiver
grapeshot
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | */mail?id=* |
| Disallow | */newsletters/bundles/* |
| Disallow | */test-de-publication-* |
| Disallow | /*%2525 |
| Disallow | /*%26edition%3D* |
| Disallow | /*%26fbclid%3D* |
| Disallow | /*%26mediego* |
| Disallow | /*%26parution%3D* |
| Disallow | /*?datasport* |
| Disallow | /*?dateCompetition=* |
| Disallow | /*?edition=* |
| Disallow | /*?fbclid=* |
| Disallow | /*?login |
| Disallow | /*?logout |
| Disallow | /*?mediego* |
| Disallow | /*?parution=* |
| Disallow | /admin/ |
| Disallow | /ajax_comment/ |
| Disallow | /balades/ |
| Disallow | /balades? |
| Disallow | /cinema/film/ |
| Disallow | /comment/reply/ |
| Disallow | /communaute/galerie-photo/*/ajout |
| Disallow | /economie/entreprises/centrale-des-marches |
| Disallow | /economie/entreprises/evenements-des-entreprises |
| Disallow | /economie/entreprises/offres-emploi |
| Disallow | /espace-contributions/ |
| Disallow | /espace-debat/utilisateur/ |
| Disallow | /etudiant/job-formation/ |
| Disallow | /examens/ |
| Disallow | /filter/tips/ |
| Disallow | /install.php |
| Disallow | /jeux-olympiques/resultats/*/?* |
| Disallow | /mail?type* |
| Disallow | /obseques/search/ |
| Disallow | /publication-statics/ |
| Disallow | /recherche/ |
| Disallow | /rpc/ |
| Disallow | /scribblelive |
| Disallow | /search/ |
| Disallow | /share/ |
| Disallow | /sport/running/*/calendrier-des-courses/?* |
| Disallow | /update.php |
| Disallow | /user |
| Disallow | /user/ |
| Disallow | /user/login/ |
| Disallow | /user/logout/ |
| Disallow | /user/password/ |
| Disallow | /user/register?* |
| Disallow | /xmlrpc.php |
exabot
slurp
ia_archiver
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ouest-france.fr/sitemap.xml |
| sitemap | https://www.ouest-france.fr/googlenews.xml |
Warnings
- 4 invalid lines.
Comments