mfsa.mt
robots.txt
Robots Exclusion Standard data for mfsa.mt
Resource Scan
Scan Details
| Site Domain | mfsa.mt |
| Base Domain | mfsa.mt |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-18T00:20:23+00:00 |
| Next Scan | 2026-03-20T00:20:23+00:00 |
Last Successful Scan
| Scanned | 2025-12-28T00:00:52+00:00 |
| URL | https://mfsa.mt/robots.txt |
| Redirect | https://www.mfsa.mt/robots.txt |
| Redirect Domain | www.mfsa.mt |
| Redirect Base | mfsa.mt |
| Domain IPs | 104.18.30.35, 104.18.31.35, 2606:4700::6812:1e23, 2606:4700::6812:1f23 |
| Redirect IPs | 104.18.30.35, 104.18.31.35, 2606:4700::6812:1e23, 2606:4700::6812:1f23 |
| Response IP | 104.18.31.35 |
| Found | Yes |
| Hash | 2c5948e177cbcd9f7074c11b615d6cabf0c7e7889dc7c3a0d4c003eb019c2140 |
| SimHash | 2140d4a4e645 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /honey_product |
| Disallow | /wp-admin |
| Disallow | /wp-content/cache |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | /*~* |
| Disallow | /*~ |
| Disallow | /course/internal-* |
| Disallow | */all-internal-courses |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |