midrag.co.il
robots.txt

Robots Exclusion Standard data for midrag.co.il

Resource Scan

Scan Details

Site Domain midrag.co.il
Base Domain midrag.co.il
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-31T11:32:04+00:00
Next Scan 2024-08-29T11:32:04+00:00

Last Successful Scan

Scanned2023-10-27T18:45:26+00:00
URL https://midrag.co.il/robots.txt
Redirect https://www.midrag.co.il:443/robots.txt
Redirect Domain www.midrag.co.il
Redirect Base midrag.co.il
Domain IPs 13.33.88.76, 13.33.88.81, 13.33.88.87, 13.33.88.94
Redirect IPs 13.33.88.76, 13.33.88.81, 13.33.88.87, 13.33.88.94
Response IP 99.84.160.118
Found Yes
Hash bc880f9f9b112e31ed0aff2101b362b531fd2d294ba579a311b520b48303c652
SimHash 85155920de12

Groups

adsbot-google

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /