francelive.fr
robots.txt
Robots Exclusion Standard data for francelive.fr
Resource Scan
Scan Details
Site Domain | francelive.fr |
Base Domain | francelive.fr |
Scan Status | Ok |
Last Scan | 2024-05-12T20:43:02+00:00 |
Next Scan | 2024-05-19T20:43:02+00:00 |
Last Scan
Scanned | 2024-05-12T20:43:02+00:00 |
URL | https://francelive.fr/robots.txt |
Redirect | https://www.francelive.fr/robots.txt |
Redirect Domain | www.francelive.fr |
Redirect Base | francelive.fr |
Domain IPs | 125.56.199.19, 125.56.199.58, 2600:1417:3f::b81c:eb59, 2600:1417:3f::b81c:eb70 |
Redirect IPs | 23.52.171.233, 23.52.171.234, 2600:1413:b000:1c::17d1:2ec4, 2600:1413:b000:1c::17d1:2ec6 |
Response IP | 23.52.171.234 |
Found | Yes |
Hash | 4c96d2b43b66037a0577e70d801a813e990eab9c93a4ae7f02c74852c3d20de3 |
SimHash | 207a5ad5c425 |
Groups
mediapartners-google
googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google
storebot-google
adsbot-google-mobile
apis-google
twitterbot
applebot
ouestfrancebot
taboolabot
proximic
upday
bingbot
exabot
slurp
ia_archiver
grapeshot
qwantbot
flipboard
flipboardproxy
exabot
slurp
ia_archiver
Rule | Path |
---|---|
Disallow | /teaser/* |
Allow | /teaser/ouest-france/ |
Allow | /teaser/le-courrier-de-l-ouest/ |
Allow | /teaser/le-courrier-de-louest/ |
Allow | /teaser/le-maine-libre/ |
Allow | /teaser/presse-ocean/ |
Allow | /teaser/voiles-et-voiliers/ |
Allow | /teaser/20-minutes/ |
Allow | /teaser/quand-partir/ |
Allow | /teaser/mce-tv/ |
Allow | /teaser/le-mag-du-senior/ |
Allow | /teaser/le-mag-du-chien/ |
Allow | /teaser/destination-sante/ |
Allow | /teaser/foot-amateur/ |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.francelive.fr/sitemap.xml |
sitemap | https://www.francelive.fr/googlenews.xml |
Warnings
- 4 invalid lines.
Comments