atlantico.fr
robots.txt
Robots Exclusion Standard data for atlantico.fr
Resource Scan
Scan Details
| Site Domain | atlantico.fr |
| Base Domain | atlantico.fr |
| Scan Status | Ok |
| Last Scan | 2024-09-21T04:13:56+00:00 |
| Next Scan | 2024-09-28T04:13:56+00:00 |
Last Scan
| Scanned | 2024-09-21T04:13:56+00:00 |
| URL | https://atlantico.fr/robots.txt |
| Domain IPs | 104.21.39.127, 172.67.145.75, 2606:4700:3035::6815:277f, 2606:4700:3036::ac43:914b |
| Response IP | 104.21.39.127 |
| Found | Yes |
| Hash | 91af6a8dbad903a8b636c18a0862ab4f41c7c9ba2824e20dd4dc74195dec10ad |
| SimHash | 8f349c14ab93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /recherche |
| Disallow | /search |
| Disallow | /explore/%5Btype%5D |
| Disallow | /article/preview/* |
| Disallow | /article/dossier/preview/* |
| Disallow | /newsletter/preview/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://atlantico.fr/sitemap-index.xml |
| sitemap | https://atlantico.fr/authors.xml |
| sitemap | https://atlantico.fr/google-news.xml |