thedibb.co.uk
robots.txt

Robots Exclusion Standard data for thedibb.co.uk

Resource Scan

Scan Details

Site Domain thedibb.co.uk
Base Domain thedibb.co.uk
Scan Status Ok
Last Scan2024-09-22T16:31:39+00:00
Next Scan 2024-09-29T16:31:39+00:00

Last Scan

Scanned2024-09-22T16:31:39+00:00
URL https://thedibb.co.uk/robots.txt
Redirect https://www.thedibb.co.uk/robots.txt
Redirect Domain www.thedibb.co.uk
Redirect Base thedibb.co.uk
Domain IPs 88.202.186.110
Redirect IPs 88.202.186.110
Response IP 88.202.186.110
Found Yes
Hash 4357e530f5740ebb988935572ff3f984896d0706b1637a058d117b2f64db55d5
SimHash 8a18c8e2a213

Groups

ahrefsbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

*

Rule Path
Disallow /banners/