sunweb.nl
robots.txt
Robots Exclusion Standard data for sunweb.nl
Resource Scan
Scan Details
Site Domain | sunweb.nl |
Base Domain | sunweb.nl |
Scan Status | Ok |
Last Scan | 2024-05-20T06:12:35+00:00 |
Next Scan | 2024-06-03T06:12:35+00:00 |
Last Scan
Scanned | 2024-05-20T06:12:35+00:00 |
URL | https://sunweb.nl/robots.txt |
Redirect | https://www.sunweb.nl/robots.txt |
Redirect Domain | www.sunweb.nl |
Redirect Base | sunweb.nl |
Domain IPs | 147.75.40.150 |
Redirect IPs | 13.215.246.123, 13.215.31.72, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e202::1f4 |
Response IP | 13.215.246.123 |
Found | Yes |
Hash | 5ef6e854564e26714bcfe00c1f16a5d1aada3c6e83ab9c05ea6bdbf857092d97 |
SimHash | 30d45bc7c4b4 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/zoeken? |
Disallow | *%26Duration* |
Disallow | *%26Participants* |
Disallow | *%26ParticipantsDistribution* |
Disallow | *%26TransportType* |
Disallow | /*/zoekactie?* |
Disallow | /sitecore |
Disallow | /*/bookingpage/* |
Disallow | /login?* |
Disallow | /mijn-sunweb* |
Other Records
Field | Value |
---|---|
sitemap | https://www.sunweb.nl/sitemap-index.xml |
Comments