cbeebies.com
robots.txt

Robots Exclusion Standard data for cbeebies.com

Resource Scan

Scan Details

Site Domain cbeebies.com
Base Domain cbeebies.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-20T15:22:03+00:00
Next Scan 2024-08-18T15:22:03+00:00

Last Successful Scan

Scanned2023-10-01T06:13:21+00:00
URL https://cbeebies.com/robots.txt
Redirect https://www.cbeebies.com/robots.txt
Redirect Domain www.cbeebies.com
Redirect Base cbeebies.com
Domain IPs 18.201.0.224, 52.212.159.195, 52.213.182.76
Redirect IPs 23.200.40.196, 23.200.40.202, 2600:1413:b000:1c::17d1:2ed5, 2600:1413:b000:1c::17d1:2edf
Response IP 23.59.168.131
Found Yes
Hash 02e68207561ebec3cf287ad28042a1a07227b0e9553e7fa35bcbc380d919070a
SimHash a2030e40fbd2

Groups

*

Rule Path
Disallow /config/

Comments

  • This space intentionally left blank
  • If you want to learn about why our robots.txt looks like this, read this post: https://yoa.st/robots-txt