sciencesetavenir.fr
robots.txt
Robots Exclusion Standard data for sciencesetavenir.fr
Resource Scan
Scan Details
| Site Domain | sciencesetavenir.fr |
| Base Domain | sciencesetavenir.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-04T17:44:54+00:00 |
| Next Scan | 2024-12-03T17:44:54+00:00 |
Last Successful Scan
| Scanned | 2023-11-10T17:16:23+00:00 |
| URL | https://sciencesetavenir.fr/robots.txt |
| Redirect | https://www.sciencesetavenir.fr:443/robots.txt |
| Redirect Domain | www.sciencesetavenir.fr |
| Redirect Base | sciencesetavenir.fr |
| Domain IPs | 54.192.111.13, 54.192.111.18, 54.192.111.4, 54.192.111.87 |
| Redirect IPs | 2600:9000:21f8:1c00:5:2ce0:f480:93a1, 2600:9000:21f8:2a00:5:2ce0:f480:93a1, 2600:9000:21f8:5200:5:2ce0:f480:93a1, 2600:9000:21f8:6200:5:2ce0:f480:93a1, 2600:9000:21f8:7800:5:2ce0:f480:93a1, 2600:9000:21f8:9000:5:2ce0:f480:93a1, 2600:9000:21f8:f200:5:2ce0:f480:93a1, 2600:9000:21f8:fa00:5:2ce0:f480:93a1, 54.192.111.13, 54.192.111.18, 54.192.111.4, 54.192.111.87 |
| Response IP | 54.192.111.13 |
| Found | Yes |
| Hash | e13576aec4ddf77c1c229154b49839a1952d6597183bb187c3ea09f0f0658513 |
| SimHash | 21c798208112 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /redis |
| Disallow | /comments |
| Disallow | /shareCount |
| Disallow | /search/* |
| Disallow | /*/commentaires |
| Disallow | /*.rss |
| Disallow | /*.atom |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sciencesetavenir.fr/sitemap.news.xml |
| sitemap | https://www.sciencesetavenir.fr/sitemap.xml |
| sitemap | https://www.sciencesetavenir.fr/sitemap-images.xml |