bbcbenelux.com
robots.txt

Robots Exclusion Standard data for bbcbenelux.com

Resource Scan

Scan Details

Site Domain bbcbenelux.com
Base Domain bbcbenelux.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-19T18:02:03+00:00
Next Scan 2024-08-17T18:02:03+00:00

Last Successful Scan

Scanned2023-09-30T15:34:38+00:00
URL https://www.bbcbenelux.com/robots.txt
Domain IPs 23.59.168.131, 2600:1413:b000:1c::17d1:2ed5, 2600:1413:b000:1c::17d1:2edf
Response IP 23.59.168.131
Found Yes
Hash 246eadbf3f04a7ecfba2895df5f0b2fe93b86f9d55c63f557b552b3642110c2d
SimHash 410cc156c531

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.bbcbenelux.com/sitemap.xml