voilesetvoiliers.ouest-france.fr
robots.txt
Robots Exclusion Standard data for voilesetvoiliers.ouest-france.fr
Resource Scan
Scan Details
Site Domain | voilesetvoiliers.ouest-france.fr |
Base Domain | ouest-france.fr |
Scan Status | Ok |
Last Scan | 2024-07-02T16:06:12+00:00 |
Next Scan | 2024-08-01T16:06:12+00:00 |
Last Scan
Scanned | 2024-07-02T16:06:12+00:00 |
URL | https://voilesetvoiliers.ouest-france.fr/robots.txt |
Domain IPs | 118.215.80.113, 2600:1413:b000:380::30db, 2600:1413:b000:386::30db |
Response IP | 23.41.79.18 |
Found | Yes |
Hash | 3370d14cfca400cd2b503ebcab4d1c35b4d97fff2cce0211dd3271b617d75cbb |
SimHash | 241e52f5c435 |
Groups
mediapartners-google
googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google
storebot-google
adsbot-google-mobile
apis-google
twitterbot
applebot
ouestfrancebot
taboolabot
proximic
upday
bingbot
exabot
slurp
ia_archiver
googlebot-news
grapeshot
Rule | Path |
---|---|
Disallow |
exabot
slurp
ia_archiver
Rule | Path |
---|---|
Disallow | /recherche/ |
Disallow | /*?login |
Disallow | /*?logout |
Disallow | /*%2525 |
Disallow | /newsletters/ |
Disallow | /*?type |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://voilesetvoiliers.ouest-france.fr/sitemap-vv.xml |
Warnings
- 4 invalid lines.
Comments