Log In Sign Up

m.sciencesetavenir.fr
robots.txt

Robots Exclusion Standard data for m.sciencesetavenir.fr

Resource Scan

Scan Details

Site Domain m.sciencesetavenir.fr
Base Domain sciencesetavenir.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-08T15:10:28+00:00
Next Scan 2024-06-06T15:10:28+00:00

Last Successful Scan

Scanned2023-10-18T03:50:00+00:00
URL https://m.sciencesetavenir.fr/robots.txt
Redirect https://www.sciencesetavenir.fr/robots.txt
Redirect Domain www.sciencesetavenir.fr
Redirect Base sciencesetavenir.fr
Domain IPs 2600:9000:20fe:0:2:81cb:91c0:93a1, 2600:9000:20fe:2600:2:81cb:91c0:93a1, 2600:9000:20fe:3600:2:81cb:91c0:93a1, 2600:9000:20fe:9000:2:81cb:91c0:93a1, 2600:9000:20fe:9600:2:81cb:91c0:93a1, 2600:9000:20fe:e600:2:81cb:91c0:93a1, 2600:9000:20fe:ea00:2:81cb:91c0:93a1, 2600:9000:20fe:ee00:2:81cb:91c0:93a1, 65.9.112.114, 65.9.112.36, 65.9.112.6, 65.9.112.8
Redirect IPs 2600:9000:2181:2200:5:2ce0:f480:93a1, 2600:9000:2181:5600:5:2ce0:f480:93a1, 2600:9000:2181:6600:5:2ce0:f480:93a1, 2600:9000:2181:8400:5:2ce0:f480:93a1, 2600:9000:2181:9800:5:2ce0:f480:93a1, 2600:9000:2181:a600:5:2ce0:f480:93a1, 2600:9000:2181:ba00:5:2ce0:f480:93a1, 2600:9000:2181:d600:5:2ce0:f480:93a1, 54.192.111.13, 54.192.111.18, 54.192.111.4, 54.192.111.87
Response IP 99.84.203.75
Found Yes
Hash e13576aec4ddf77c1c229154b49839a1952d6597183bb187c3ea09f0f0658513
SimHash 21c798208112

Groups

*

Rule Path
Disallow /redis
Disallow /comments
Disallow /shareCount
Disallow /search/*
Disallow /*/commentaires
Disallow /*.rss
Disallow /*.atom

riddler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sciencesetavenir.fr/sitemap.news.xml
sitemap https://www.sciencesetavenir.fr/sitemap.xml
sitemap https://www.sciencesetavenir.fr/sitemap-images.xml
Back to top