carrefour.co.il
robots.txt

Robots Exclusion Standard data for carrefour.co.il

Resource Scan

Scan Details

Site Domain carrefour.co.il
Base Domain carrefour.co.il
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-25T01:12:42+00:00
Next Scan 2024-07-24T01:12:42+00:00

Last Successful Scan

Scanned2024-03-04T00:32:18+00:00
URL https://carrefour.co.il/robots.txt
Redirect https://www.carrefour.co.il/robots.txt
Redirect Domain www.carrefour.co.il
Redirect Base carrefour.co.il
Domain IPs 34.246.4.57, 52.18.211.240
Redirect IPs 13.33.88.120, 13.33.88.52, 13.33.88.58, 13.33.88.60, 2600:9000:223b:2a00:12:8563:3e80:93a1, 2600:9000:223b:3200:12:8563:3e80:93a1, 2600:9000:223b:5800:12:8563:3e80:93a1, 2600:9000:223b:b200:12:8563:3e80:93a1, 2600:9000:223b:b400:12:8563:3e80:93a1, 2600:9000:223b:be00:12:8563:3e80:93a1, 2600:9000:223b:c00:12:8563:3e80:93a1, 2600:9000:223b:ce00:12:8563:3e80:93a1
Response IP 13.33.88.120
Found Yes
Hash 0428bf950a018d58c0ec92ca885385711c567ec263617cfd32a9cf76465a6fd7
SimHash 4944d003c5b3

Groups

*

Rule Path
Allow /
Disallow /?section=*

Other Records

Field Value
sitemap https://www.carrefour.co.il/sitemap.xml