mwe.com
robots.txt
Robots Exclusion Standard data for mwe.com
Resource Scan
Scan Details
| Site Domain | mwe.com |
| Base Domain | mwe.com |
| Scan Status | Ok |
| Last Scan | 2025-11-20T07:32:48+00:00 |
| Next Scan | 2025-12-20T07:32:48+00:00 |
Last Scan
| Scanned | 2025-11-20T07:32:48+00:00 |
| URL | https://mwe.com/robots.txt |
| Redirect | https://www.mwe.com/robots.txt |
| Redirect Domain | www.mwe.com |
| Redirect Base | mwe.com |
| Domain IPs | 45.60.121.248, 45.60.131.248 |
| Redirect IPs | 45.60.125.248 |
| Response IP | 45.60.125.248 |
| Found | Yes |
| Hash | a9c13f9df3ee3194201afb4061d1eaee71163b1e20652c24acb8105a8f415b65 |
| SimHash | aa29cac14693 |
Groups
elastic crawler
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-admin/ |
| Disallow | /lp/ |
| Disallow | /petitions/* |
| Disallow | /legal/mosa-one* |
| Disallow | /resource-pagination/ |
| Disallow | /media-pagination/ |
| Disallow | /events-pagination/ |
| Disallow | /insights-pagination/ |
| Disallow | /pdf-download/ |
linkedinbot
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-admin/ |
| Disallow | /lp/ |
| Disallow | /petitions/* |
| Disallow | /legal/mosa-one* |
| Disallow | /resource-pagination/ |
| Disallow | /media-pagination/ |
| Disallow | /events-pagination/ |
| Disallow | /insights-pagination/ |
| Disallow | /pdf-download/ |
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-admin/ |
| Disallow | /lp/ |
| Disallow | /petitions/* |
| Disallow | /legal/mosa-one* |
| Disallow | /it/* |
| Disallow | /fr/* |
| Disallow | /resource-pagination/ |
| Disallow | /media-pagination/ |
| Disallow | /events-pagination/ |
| Disallow | /insights-pagination/ |
| Disallow | /pdf-download/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mwe.com/sitemap_index.xml |