methven.com
robots.txt
Robots Exclusion Standard data for methven.com
Resource Scan
Scan Details
Site Domain | methven.com |
Base Domain | methven.com |
Scan Status | Ok |
Last Scan | 2025-08-11T14:01:35+00:00 |
Next Scan | 2025-09-10T14:01:35+00:00 |
Last Scan
Scanned | 2025-08-11T14:01:35+00:00 |
URL | https://methven.com/robots.txt |
Redirect | https://www.methven.com/robots.txt |
Redirect Domain | www.methven.com |
Redirect Base | methven.com |
Domain IPs | 15.197.167.90, 3.33.186.135, 75.2.60.5 |
Redirect IPs | 104.18.22.2, 104.18.23.2, 2606:4700::6812:1602, 2606:4700::6812:1702 |
Response IP | 104.18.23.2 |
Found | Yes |
Hash | f54c2517d1fd470fca7e19114f7eb36366dd62b322fbd4b24aecb1d8609191f5 |
SimHash | 680cd0002813 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /__preview |
Disallow | /uk/ |
Disallow | /*?category |
Disallow | /*?collection |
Disallow | /*?query |
Other Records
Field | Value |
---|---|
sitemap | https://www.methven.com/au/sitemap-static.xml |
sitemap | https://www.methven.com/au/sitemap-products.xml |
sitemap | https://www.methven.com/nz/sitemap-static.xml |
sitemap | https://www.methven.com/nz/sitemap-products.xml |