beta.trouw.nl
robots.txt
Robots Exclusion Standard data for beta.trouw.nl
Resource Scan
Scan Details
Site Domain | beta.trouw.nl |
Base Domain | trouw.nl |
Scan Status | Ok |
Last Scan | 2024-06-04T11:08:40+00:00 |
Next Scan | 2024-06-11T11:08:40+00:00 |
Last Scan
Scanned | 2024-06-04T11:08:40+00:00 |
URL | https://beta.trouw.nl/robots.txt |
Redirect | https://www.trouw.nl/robots.txt |
Redirect Domain | www.trouw.nl |
Redirect Base | trouw.nl |
Domain IPs | 23.44.4.136, 23.44.4.139, 2600:1413:a000::1734:2839, 2600:1413:a000::1734:2848 |
Redirect IPs | 23.44.4.170, 23.44.4.176, 2600:1413:a000::1734:2848 |
Response IP | 23.44.4.176 |
Found | Yes |
Hash | 91fec82c667cfe4f94fbd1b4004b0a03e3bd7c101135b1a137920ca323059803 |
SimHash | 49500b594f75 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*?otag* |
Disallow | /*?abo_type* |
Disallow | /*?URL_referrer* |
Disallow | /auth/ |
Disallow | /temptation/ |
Disallow | /*utm_campaign%3Dshared_earned* |
Disallow | /*redirectUri%3D* |
Disallow | /zoeken?query=* |
Disallow | /search?query=* |
Disallow | /tag/*?page= |
Other Records
Field | Value |
---|---|
sitemap | https://www.trouw.nl/sitemap.xml |
Comments