meltek.io
robots.txt
Robots Exclusion Standard data for meltek.io
Resource Scan
Scan Details
| Site Domain | meltek.io |
| Base Domain | meltek.io |
| Scan Status | Ok |
| Last Scan | 2025-12-21T17:38:32+00:00 |
| Next Scan | 2026-01-20T17:38:32+00:00 |
Last Scan
| Scanned | 2025-12-21T17:38:32+00:00 |
| URL | https://meltek.io/robots.txt |
| Redirect | https://meltek.com/robots.txt |
| Redirect Domain | meltek.com |
| Redirect Base | meltek.com |
| Domain IPs | 13.203.125.58, 13.233.175.166, 3.109.243.18 |
| Redirect IPs | 104.26.12.33, 104.26.13.33, 172.67.74.193, 2606:4700:20::681a:c21, 2606:4700:20::681a:d21, 2606:4700:20::ac43:4ac1 |
| Response IP | 104.26.13.33 |
| Found | Yes |
| Hash | 68b89b88b2b412405c70424894a029f57571c208f6a4c2ae0ddeded5c4377d2f |
| SimHash | 4b180ed0cf72 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /admin/ |
| Disallow | /_next/ |
| Disallow | /auth/ |
| Disallow | /help/ |
| Disallow | /calculator/ |
| Disallow | /demo/ |
| Disallow | /coned/ |
| Disallow | /signup/ |
| Disallow | /dashboard/ |
| Disallow | /home/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://meltek.com/sitemap.xml |