meltoday.com
robots.txt
Robots Exclusion Standard data for meltoday.com
Resource Scan
Scan Details
| Site Domain | meltoday.com |
| Base Domain | meltoday.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T21:10:18+00:00 |
| Next Scan | 2024-11-15T21:10:18+00:00 |
Last Scan
| Scanned | 2024-11-08T21:10:18+00:00 |
| URL | https://meltoday.com/robots.txt |
| Redirect | https://www.meltoday.com/robots.txt |
| Redirect Domain | www.meltoday.com |
| Redirect Base | meltoday.com |
| Domain IPs | 104.26.8.35, 104.26.9.35, 172.67.72.107, 2606:4700:20::681a:823, 2606:4700:20::681a:923, 2606:4700:20::ac43:486b |
| Redirect IPs | 104.26.8.35, 104.26.9.35, 172.67.72.107, 2606:4700:20::681a:823, 2606:4700:20::681a:923, 2606:4700:20::ac43:486b |
| Response IP | 172.67.72.107 |
| Found | Yes |
| Hash | d0e7c11698119bb2f4bd8086c014475e7de5099cf43211b5952ceed8ad7c1aa7 |
| SimHash | a84d4860c593 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.jpg |
| Disallow | /*.jpeg |
| Disallow | /*.png |
| Disallow | /*.gif |
| Disallow | /user/ |
| Disallow | /Edit/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cdn36.sydneytoday.com/sitemap.xml |
| sitemap | https://cdn36.meltoday.com/sitemap.xml |