info24.co.il
robots.txt

Robots Exclusion Standard data for info24.co.il

Resource Scan

Scan Details

Site Domain info24.co.il
Base Domain info24.co.il
Scan Status Ok
Last Scan2026-01-09T01:38:54+00:00
Next Scan 2026-02-08T01:38:54+00:00

Last Scan

Scanned2026-01-09T01:38:54+00:00
URL https://info24.co.il/robots.txt
Domain IPs 104.21.93.203, 172.67.214.94, 2606:4700:3035::ac43:d65e, 2606:4700:3037::6815:5dcb
Response IP 172.67.214.94
Found Yes
Hash 14f2040ce37116142ff7d8c6704a0dcef4c32b759e214912f85cfbc52db5c91b
SimHash 511dc432ee90

Groups

*

Rule Path
Disallow /admin/
Allow /

claudebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://info24.co.il/sitemap.xml