beta.bbc.co.uk
robots.txt

Robots Exclusion Standard data for beta.bbc.co.uk

Resource Scan

Scan Details

Site Domain beta.bbc.co.uk
Base Domain bbc.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-25T19:41:42+00:00
Next Scan 2024-06-23T19:41:42+00:00

Last Successful Scan

Scanned2023-03-01T15:38:51+00:00
URL https://beta.bbc.co.uk/robots.txt
Redirect https://ssl.bbc.co.uk/robots.txt
Redirect Domain ssl.bbc.co.uk
Redirect Base bbc.co.uk
Domain IPs 212.58.244.82, 212.58.249.118
Redirect IPs 212.58.244.114, 212.58.249.190
Response IP 212.58.244.114
Found Yes
Hash b782a9466ac65499eeca6fbcb4ea2fc0dce5f020e1b5ca77e4033bec046f013c
SimHash 983cd882cb82

Groups

*

Rule Path
Disallow /

Comments

  • version: 69d5da086094788b157170e7627192444d8cdd5e
  • https://ssl.bbc.co.uk