chevalnatureetdecouverte.com
robots.txt

Robots Exclusion Standard data for chevalnatureetdecouverte.com

Resource Scan

Scan Details

Site Domain chevalnatureetdecouverte.com
Base Domain chevalnatureetdecouverte.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-12T12:40:21+00:00
Next Scan 2024-10-10T12:40:21+00:00

Last Successful Scan

Scanned2023-03-21T00:49:49+00:00
URL http://chevalnatureetdecouverte.com/robots.txt
Redirect http://www.chevalnatureetdecouverte.com/robots.txt
Redirect Domain www.chevalnatureetdecouverte.com
Redirect Base chevalnatureetdecouverte.com
Domain IPs 195.154.21.79
Redirect IPs 195.154.21.79
Response IP 195.154.21.79
Found Yes
Hash 58bce54d0ed07d44671f87f7b30b788761e79b75d8ef11c6368d594b09b6dda2
SimHash ab5edc406618

Groups

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

httrack

Rule Path
Disallow /

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seekport crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /
Disallow /storage/do_xml/id/

Other Records

Field Value
sitemap http://www.chevalnatureetdecouverte.com/sitemap.xml