today.rtl.lu
robots.txt

Robots Exclusion Standard data for today.rtl.lu

Resource Scan

Scan Details

Site Domain today.rtl.lu
Base Domain rtl.lu
Scan Status Ok
Last Scan2025-12-02T23:29:48+00:00
Next Scan 2026-01-01T23:29:48+00:00

Last Scan

Scanned2025-12-02T23:29:48+00:00
URL https://today.rtl.lu/robots.txt
Domain IPs 108.138.199.103, 108.138.199.112, 108.138.199.120, 108.138.199.96, 2600:9000:21f8:5c00:1a:a322:2d40:93a1, 2600:9000:21f8:6200:1a:a322:2d40:93a1, 2600:9000:21f8:6a00:1a:a322:2d40:93a1, 2600:9000:21f8:6e00:1a:a322:2d40:93a1, 2600:9000:21f8:7c00:1a:a322:2d40:93a1, 2600:9000:21f8:ce00:1a:a322:2d40:93a1, 2600:9000:21f8:d800:1a:a322:2d40:93a1, 2600:9000:21f8:f800:1a:a322:2d40:93a1
Response IP 13.226.2.17
Found Yes
Hash 506ba456e5e738164107d39c950dcab7f4c95a481953fe54d9690fc3a649a554
SimHash d37c0c1869d0

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /__IPL/
Disallow /__IPL_DFP/
Disallow /__IPL_VIDEO/
Disallow /media/
Disallow /*/*/ra/*
Disallow /tele/hidden/v/