jeux.ouest-france.fr
robots.txt
Robots Exclusion Standard data for jeux.ouest-france.fr
Resource Scan
Scan Details
Site Domain | jeux.ouest-france.fr |
Base Domain | ouest-france.fr |
Scan Status | Ok |
Last Scan | 2024-06-22T03:40:15+00:00 |
Next Scan | 2024-07-22T03:40:15+00:00 |
Last Scan
Scanned | 2024-06-22T03:40:15+00:00 |
URL | https://jeux.ouest-france.fr/robots.txt |
Domain IPs | 104.69.163.117, 2600:1413:1:593::30db, 2600:1413:1:59c::30db |
Response IP | 23.41.79.18 |
Found | Yes |
Hash | 29c7c3c4522034b24f301b53d983aeb77297a72aa094a70d3c358c900d30d8ed |
SimHash | 241e52f5c635 |
Groups
mediapartners-google
googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google
storebot-google
adsbot-google-mobile
apis-google
twitterbot
applebot
ouestfrancebot
taboolabot
proximic
upday
bingbot
exabot
slurp
ia_archiver
googlebot-news
grapeshot
Rule | Path |
---|---|
Disallow |
exabot
slurp
ia_archiver
Rule | Path |
---|---|
Disallow | /*?login |
Disallow | /*?logout |
Disallow | /*%2525 |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 4 invalid lines.
Comments