mfsengineering.com.au
robots.txt
Robots Exclusion Standard data for mfsengineering.com.au
Resource Scan
Scan Details
| Site Domain | mfsengineering.com.au |
| Base Domain | mfsengineering.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-27T22:21:13+00:00 |
| Next Scan | 2025-11-26T22:21:13+00:00 |
Last Successful Scan
| Scanned | 2025-09-05T15:31:49+00:00 |
| URL | https://mfsengineering.com.au/robots.txt |
| Domain IPs | 104.26.14.139, 104.26.15.139, 172.67.75.77, 2606:4700:20::681a:e8b, 2606:4700:20::681a:f8b, 2606:4700:20::ac43:4b4d |
| Response IP | 104.26.14.139 |
| Found | Yes |
| Hash | b91a594ab0ee7ba17971c2e44e5a5c62fa344b026e8fb34ac188ab1340c752d6 |
| SimHash | 6b31d3418181 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-content/uploads/ |
| Allow | /*.js$ |
| Allow | /*.css$ |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.svg$ |
| Allow | /*.webp$ |
| Allow | /wp-includes/js/jquery/jquery.min.js |
| Allow | /wp-includes/css/dist/block-library/style.min.css |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /wp-mail.php |
| Disallow | /*?*s= |
| Disallow | /search/ |
| Disallow | *?add-to-cart=* |
| Disallow | *?add_to_wishlist=* |
| Disallow | *?filter=* |
| Disallow | *?orderby=* |
| Disallow | *%26p%3D* |
| Disallow | *?preview=* |
| Disallow | /feed/ |
| Disallow | /comments/feed/ |
| Disallow | */feed/$ |
| Disallow | */feed/rss/$ |
| Disallow | */feed/rss2/$ |
| Disallow | */feed/rdf/$ |
| Disallow | */feed/atom/$ |
| Disallow | */rss/$ |
| Disallow | */rdf/$ |
| Disallow | */atom/$ |
| Allow | /sitemap_index.xml |
| Allow | /sitemap.xml |
| Allow | /*sitemap.xml |
| Allow | /*sitemap.xml.gz |
Other Records
| Field | Value |
|---|---|
| sitemap | https://mfsengineering.com.au/sitemap_index.xml |
Comments