mayerline.be
robots.txt
Robots Exclusion Standard data for mayerline.be
Resource Scan
Scan Details
| Site Domain | mayerline.be |
| Base Domain | mayerline.be |
| Scan Status | Ok |
| Last Scan | 2025-11-30T23:30:48+00:00 |
| Next Scan | 2025-12-14T23:30:48+00:00 |
Last Scan
| Scanned | 2025-11-30T23:30:48+00:00 |
| URL | https://www.mayerline.be/robots.txt |
| Domain IPs | 104.18.38.155, 172.64.149.101 |
| Response IP | 172.64.149.101 |
| Found | Yes |
| Hash | dbcb152e8d97c14a88871a397669eb66870c5d7868c3677fd8eb681afcbb6732 |
| SimHash | 647351d4e7b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /on/demandware.store/* |
| Disallow | *Login-* |
| Disallow | *Register-* |
| Disallow | *ProductLists-* |
| Disallow | *Checkout-* |
| Disallow | *Account-* |
| Disallow | *Order-* |
| Disallow | /*null* |
| Disallow | /*/passwordreset/ |
| Disallow | /*/account/ |
| Disallow | /*/orders/ |
| Disallow | /*/profile/ |
| Allow | /*?dwvar |
| Allow | /*utm_medium%3Dmerchant |
| Disallow | /*/search* |
| Disallow | /*pmin* |
| Disallow | /*pmax* |
| Disallow | /*srule%3D* |
| Disallow | /*?q=* |
| Disallow | /*prefv*%3D* |
| Disallow | /*prefn*%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mayerline.be/sitemap_index.xml |
Warnings
- 2 invalid lines.
- `noindex` is not a known field.
Comments