alumcrystal.co.il
robots.txt
Robots Exclusion Standard data for alumcrystal.co.il
Resource Scan
Scan Details
| Site Domain | alumcrystal.co.il |
| Base Domain | alumcrystal.co.il |
| Scan Status | Ok |
| Last Scan | 2024-09-28T20:59:51+00:00 |
| Next Scan | 2024-10-28T20:59:51+00:00 |
Last Scan
| Scanned | 2024-09-28T20:59:51+00:00 |
| URL | https://alumcrystal.co.il/robots.txt |
| Redirect | https://www.alumcrystal.co.il/robots.txt |
| Redirect Domain | www.alumcrystal.co.il |
| Redirect Base | alumcrystal.co.il |
| Domain IPs | 54.76.177.85 |
| Redirect IPs | 54.246.39.176 |
| Response IP | 54.246.39.176 |
| Found | Yes |
| Hash | 1eee9c51a656d2e1624d020a05eb1214225bbe0f052fa903910ed645f1d8bd08 |
| SimHash | eb0d9c60eaba |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.alumcrystal.co.il/sitemap.asp?depart_id=112819 |