la1ere.francetvinfo.fr
robots.txt
Robots Exclusion Standard data for la1ere.francetvinfo.fr
Resource Scan
Scan Details
Site Domain | la1ere.francetvinfo.fr |
Base Domain | francetvinfo.fr |
Scan Status | Ok |
Last Scan | 2024-05-17T21:54:29+00:00 |
Next Scan | 2024-05-24T21:54:29+00:00 |
Last Scan
Scanned | 2024-05-17T21:54:29+00:00 |
URL | https://la1ere.francetvinfo.fr/robots.txt |
Domain IPs | 23.59.168.98, 2600:1413:1::1720:1d5b, 2600:1413:1::1720:1d62 |
Response IP | 23.52.40.83 |
Found | Yes |
Hash | 413b0592e6133bfbf3564902efd3495bdecfcf2a8dc68d1726852b2eff31964c |
SimHash | 34187800ef80 |
Groups
*
Rule | Path |
---|---|
Disallow | /playlist-histoires-14-18/ |
Disallow | */diffusion/* |
Disallow | /?q=admin%2F |
Disallow | /?q=comment%2Freply%2F |
Disallow | /?q=filter%2Ftips%2F |
Disallow | /?q=node%2Fadd%2F |
Disallow | /?q=user%2Fpassword%2F |
Disallow | /?q=user%2Fregister%2F |
Disallow | /?q=user%2Flogin%2F |
Disallow | /?q=user%2Flogout%2F |
Disallow | /?q=static%2F |
Disallow | /*related-data/ |
Disallow | /*same-topic-data/ |
Disallow | /*rss-data/ |
Disallow | /*grands-dossiers-data/ |
Disallow | /*ecouter-outremer-data/ |
Disallow | *html?marketing= |
Disallow | *html?fbclid= |
Disallow | *html?gclid= |
Disallow | *html?hash= |
Disallow | *html?affId= |
Disallow | *html?trk= |
Disallow | /bandeau-api/* |
Disallow | /api/menu/franceinfo |
Comments