screg.fr
robots.txt

Robots Exclusion Standard data for screg.fr

Resource Scan

Scan Details

Site Domain screg.fr
Base Domain screg.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-07T01:46:15+00:00
Next Scan 2024-11-21T01:46:15+00:00

Last Successful Scan

Scanned2024-09-30T00:16:30+00:00
URL http://www.screg.fr/robots.txt
Redirect https://www.colas.com/robots.txt
Redirect Domain www.colas.com
Redirect Base colas.com
Domain IPs 213.152.5.124
Redirect IPs 23.215.7.10, 23.215.7.23, 2600:1413:b000:1b::17d7:70a, 2600:1413:b000:1b::17d7:717
Response IP 184.50.85.172
Found Yes
Hash 43f10d95cf8da778725e1e63e1f10de39473d0dd3c374821039a6735e11933a8
SimHash c9040a428f91

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /static/

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.colas.com/sitemap/sitemap-index.xml

Warnings

  • `host` is not a known field.