bitdeer.ai
robots.txt

Robots Exclusion Standard data for bitdeer.ai

Resource Scan

Scan Details

Site Domain bitdeer.ai
Base Domain bitdeer.ai
Scan Status Ok
Last Scan2025-11-04T08:32:03+00:00
Next Scan 2025-12-04T08:32:03+00:00

Last Scan

Scanned2025-11-04T08:32:03+00:00
URL https://bitdeer.ai/robots.txt
Redirect https://www.bitdeer.ai/robots.txt
Redirect Domain www.bitdeer.ai
Redirect Base bitdeer.ai
Domain IPs 104.18.24.32, 104.18.25.32, 2606:4700::6812:1820, 2606:4700::6812:1920
Redirect IPs 104.18.24.32, 104.18.25.32, 2606:4700::6812:1820, 2606:4700::6812:1920
Response IP 104.18.24.32
Found Yes
Hash 2cd592e580bd7021cb7ada27bcd2c5998b1af6fb547e8d67f140066967d87bce
SimHash a909cc70c2b3

Groups

*

Rule Path
Allow /
Disallow /cdn-cgi/l/email-protection
Disallow /en/docs/vms/user-data/

Other Records

Field Value
sitemap https://www.bitdeer.ai/sitemap.xml
sitemap https://www.bitdeer.ai/en-sitemap.xml
sitemap https://www.bitdeer.ai/zh-sitemap.xml