homeless.co.il
robots.txt

Robots Exclusion Standard data for homeless.co.il

Resource Scan

Scan Details

Site Domain homeless.co.il
Base Domain homeless.co.il
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-01T08:46:38+00:00
Next Scan 2024-12-30T08:46:38+00:00

Last Successful Scan

Scanned2023-09-13T20:37:04+00:00
URL https://homeless.co.il/robots.txt
Redirect https://www.homeless.co.il/robots.txt
Redirect Domain www.homeless.co.il
Redirect Base homeless.co.il
Domain IPs 104.26.8.161, 104.26.9.161, 172.67.71.91, 2606:4700:20::681a:8a1, 2606:4700:20::681a:9a1, 2606:4700:20::ac43:475b
Redirect IPs 104.26.8.161, 104.26.9.161, 172.67.71.91, 2606:4700:20::681a:8a1, 2606:4700:20::681a:9a1, 2606:4700:20::ac43:475b
Response IP 104.26.9.161
Found Yes
Hash a87d70cf2b95bf85a1f47087a29e74857f5e80d0f78d5f0a4069bd368f80a07f
SimHash 612cc868cb90

Groups

*

Rule Path
Disallow /board/xmlcache
Disallow /index/xmlcache