beta-architecture.com
robots.txt

Robots Exclusion Standard data for beta-architecture.com

Resource Scan

Scan Details

Site Domain beta-architecture.com
Base Domain beta-architecture.com
Scan Status Ok
Last Scan2025-12-13T02:48:57+00:00
Next Scan 2025-12-20T02:48:57+00:00

Last Scan

Scanned2025-12-13T02:48:57+00:00
URL https://beta-architecture.com/robots.txt
Domain IPs 2001:8d8:100f:f000::202, 217.160.0.107
Response IP 217.160.0.107
Found Yes
Hash e0ad107ea2f9983e308d01b4b7d0cc8b92967bb951e6e42c32f2b9b93444a09b
SimHash 89345f245850

Groups

bot*

Rule Path
Disallow /

crawl

Rule Path
Disallow /

java (often spam bot)

Rule Path
Disallow /