barandbench.com
robots.txt

Robots Exclusion Standard data for barandbench.com

Resource Scan

Scan Details

Site Domain barandbench.com
Base Domain barandbench.com
Scan Status Ok
Last Scan2024-11-09T15:29:18+00:00
Next Scan 2024-11-16T15:29:18+00:00

Last Scan

Scanned2024-11-09T15:29:18+00:00
URL https://barandbench.com/robots.txt
Redirect https://www.barandbench.com/robots.txt
Redirect Domain www.barandbench.com
Redirect Base barandbench.com
Domain IPs 23.20.179.164, 54.158.195.16
Redirect IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.90.198
Found Yes
Hash 87490d58043af28f5daab085c2318ac20f7a7a40bedd42d1876174fa207898a7
SimHash 907ed4520742

Groups

semrush

Rule Path
Disallow /

ahref

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

open ai

Rule Path
Disallow /