amp.ouest-france.fr
robots.txt
Robots Exclusion Standard data for amp.ouest-france.fr
Resource Scan
Scan Details
| Site Domain | amp.ouest-france.fr |
| Base Domain | ouest-france.fr |
| Scan Status | Ok |
| Last Scan | 2024-06-19T21:34:42+00:00 |
| Next Scan | 2024-06-26T21:34:42+00:00 |
Last Scan
| Scanned | 2024-06-19T21:34:42+00:00 |
| URL | https://amp.ouest-france.fr/robots.txt |
| Redirect | https://www.ouest-france.fr/robots.txt |
| Redirect Domain | www.ouest-france.fr |
| Redirect Base | ouest-france.fr |
| Domain IPs | 104.69.163.117, 2600:1413:1:593::30db, 2600:1413:1:59c::30db |
| Redirect IPs | 23.39.13.188 |
| Response IP | 23.39.13.188 |
| Found | Yes |
| Hash | e175f7e25dc095ca51738735c6dfcfc5390df52ce23aa084783b45a326cda374 |
| SimHash | a87b50958437 |
Groups
mediapartners-google
googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google
storebot-google
adsbot-google-mobile
apis-google
twitterbot
applebot
ouestfrancebot
taboolabot
proximic
upday
bingbot
exabot
slurp
ia_archiver
grapeshot
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | */mail?id=* |
| Disallow | */newsletters/bundles/* |
| Disallow | */test-de-publication-* |
| Disallow | /*%2525 |
| Disallow | /*%26edition%3D* |
| Disallow | /*%26fbclid%3D* |
| Disallow | /*%26mediego* |
| Disallow | /*%26parution%3D* |
| Disallow | /*?datasport* |
| Disallow | /*?dateCompetition=* |
| Disallow | /*?edition=* |
| Disallow | /*?fbclid=* |
| Disallow | /*?login |
| Disallow | /*?logout |
| Disallow | /*?mediego* |
| Disallow | /*?parution=* |
| Disallow | /admin/ |
| Disallow | /ajax_comment/ |
| Disallow | /balades/ |
| Disallow | /balades? |
| Disallow | /cinema/film/ |
| Disallow | /comment/reply/ |
| Disallow | /communaute/galerie-photo/*/ajout |
| Disallow | /economie/entreprises/centrale-des-marches |
| Disallow | /economie/entreprises/evenements-des-entreprises |
| Disallow | /economie/entreprises/offres-emploi |
| Disallow | /espace-contributions/ |
| Disallow | /espace-debat/utilisateur/ |
| Disallow | /etudiant/job-formation/ |
| Disallow | /examens/ |
| Disallow | /filter/tips/ |
| Disallow | /install.php |
| Disallow | /mail?type* |
| Disallow | /obseques/search/ |
| Disallow | /publication-statics/ |
| Disallow | /recherche/ |
| Disallow | /rpc/ |
| Disallow | /scribblelive |
| Disallow | /search/ |
| Disallow | /share/ |
| Disallow | /sport/running/*/calendrier-des-courses/?* |
| Disallow | /update.php |
| Disallow | /user |
| Disallow | /user/ |
| Disallow | /user/login/ |
| Disallow | /user/logout/ |
| Disallow | /user/password/ |
| Disallow | /user/register?* |
| Disallow | /xmlrpc.php |
exabot
slurp
ia_archiver
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ouest-france.fr/sitemap.xml |
| sitemap | https://www.ouest-france.fr/googlenews.xml |
Warnings
- 4 invalid lines.
Comments