larc-en-ciel.com
robots.txt

Robots Exclusion Standard data for larc-en-ciel.com

Resource Scan

Scan Details

Site Domain larc-en-ciel.com
Base Domain larc-en-ciel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-14T14:42:10+00:00
Next Scan 2024-06-13T14:42:10+00:00

Last Successful Scan

Scanned2023-01-28T11:42:45+00:00
URL https://larc-en-ciel.com/robots.txt
Domain IPs 13.33.88.100, 13.33.88.11, 13.33.88.119, 13.33.88.74
Response IP 13.33.88.119
Found Yes
Hash 5afdeeb5661217c3932d1adb3fda4a7ef33a129228dd602309d10b33f3b2ab38
SimHash 987cd523ee9a

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

archiveteam archivebot

Rule Path
Disallow /