mews.com
robots.txt
Robots Exclusion Standard data for mews.com
Resource Scan
Scan Details
Site Domain | mews.com |
Base Domain | mews.com |
Scan Status | Ok |
Last Scan | 2024-04-30T21:23:09+00:00 |
Next Scan | 2024-05-30T21:23:09+00:00 |
Last Scan
Scanned | 2024-04-30T21:23:09+00:00 |
URL | https://mews.com/robots.txt |
Redirect | https://www.mews.com/robots.txt |
Redirect Domain | www.mews.com |
Redirect Base | mews.com |
Domain IPs | 104.18.42.174, 172.64.145.82, 2606:4700:4400::6812:2aae, 2606:4700:4400::ac40:9152 |
Redirect IPs | 199.60.103.225, 199.60.103.31, 2606:2c40::c73c:671f, 2606:2c40::c73c:67e1 |
Response IP | 199.60.103.31 |
Found | Yes |
Hash | 655a8b014ba4e110a6345aafade5a76995803f59f184dd748bdf6dbe177da051 |
SimHash | 3a424654438a |
Groups
*
Rule | Path |
---|---|
Disallow | /en/search?* |
Disallow | /es/buscar?* |
Disallow | /de/suchen?* |
Disallow | /fr/recherche?* |
Disallow | /nl/zoeken?* |
Disallow | /offer/* |
Disallow | /test/* |
Disallow | /test-blog* |
Disallow | */feed |
Disallow | /*?contact_free= |
Disallow | /*?v= |
Disallow | /*?plug_and_play= |
Disallow | /*?gh_jid=* |
Disallow | /*/campaigns/* |
Disallow | /*/blog/author/* |
Disallow | /en/test-qualified |
Disallow | /en/products/test-* |
Disallow | /_hcms/preview/ |
Disallow | /hs/manage-preferences/ |
Disallow | /hs/preferences-center/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.mews.com/sitemap.xml |