expert.nl
robots.txt
Robots Exclusion Standard data for expert.nl
Resource Scan
Scan Details
| Site Domain | expert.nl |
| Base Domain | expert.nl |
| Scan Status | Ok |
| Last Scan | 2024-05-28T22:13:12+00:00 |
| Next Scan | 2024-06-27T22:13:12+00:00 |
Last Scan
| Scanned | 2024-05-28T22:13:12+00:00 |
| URL | https://expert.nl/robots.txt |
| Redirect | https://www.expert.nl/robots.txt |
| Redirect Domain | www.expert.nl |
| Redirect Base | expert.nl |
| Domain IPs | 104.24.16.43, 104.24.17.43 |
| Redirect IPs | 104.26.10.243, 104.26.11.243, 172.67.73.240 |
| Response IP | 104.26.10.243 |
| Found | Yes |
| Hash | abc77afb9bdf0fa1100b747706d58d98c947eebc3adf7335dfadaab8bd3653e8 |
| SimHash | 3d1499502610 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?grid=* |
| Disallow | /*%26grid%3D* |
| Disallow | /*?sort=* |
| Disallow | /*%26sort%3D* |
| Disallow | /*page-size%3D* |
| Disallow | /vendor/* |
| Disallow | /customer/* |
| Disallow | /checkout/* |
| Disallow | /vergelijken/* |
| Disallow | /print/* |
| Disallow | /search/* |
| Disallow | /search?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.expert.nl/storage/media/sitemap/default/sitemap.xml |
Comments