ecrivaines17et18.com
robots.txt

Robots Exclusion Standard data for ecrivaines17et18.com

Resource Scan

Scan Details

Site Domain ecrivaines17et18.com
Base Domain ecrivaines17et18.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-08-27T08:58:51+00:00
Next Scan 2024-11-25T08:58:51+00:00

Last Successful Scan

Scanned2022-11-04T19:33:13+00:00
URL http://ecrivaines17et18.com/robots.txt
Redirect http://www.ecrivaines17et18.com/robots.txt
Redirect Domain www.ecrivaines17et18.com
Redirect Base ecrivaines17et18.com
Response IP 195.154.21.85
Found Yes
Hash 3fd26d92b2138774c3522afe0c361ba29fcab4278c6fd66fc4d891a2bd8760db
SimHash ab5edc406632

Groups

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

httrack

Rule Path
Disallow /

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seekport crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /
Disallow /storage/do_xml/id/

Other Records

Field Value
sitemap http://www.ecrivaines17et18.com/sitemap.xml