custodia.ai
robots.txt

Robots Exclusion Standard data for custodia.ai

Resource Scan

Scan Details

Site Domain custodia.ai
Base Domain custodia.ai
Scan Status Ok
Last Scan2025-10-25T08:32:01+00:00
Next Scan 2025-11-24T08:32:01+00:00

Last Scan

Scanned2025-10-25T08:32:01+00:00
URL https://custodia.ai/robots.txt
Redirect https://www.custodia.ai/robots.txt
Redirect Domain www.custodia.ai
Redirect Base custodia.ai
Domain IPs 13.35.238.120, 13.35.238.126, 13.35.238.19, 13.35.238.61, 2600:9000:2085:400:f:1ded:6e80:93a1, 2600:9000:2085:5c00:f:1ded:6e80:93a1, 2600:9000:2085:5e00:f:1ded:6e80:93a1, 2600:9000:2085:6e00:f:1ded:6e80:93a1, 2600:9000:2085:da00:f:1ded:6e80:93a1, 2600:9000:2085:dc00:f:1ded:6e80:93a1, 2600:9000:2085:e800:f:1ded:6e80:93a1, 2600:9000:2085:f400:f:1ded:6e80:93a1
Redirect IPs 13.35.238.120, 13.35.238.126, 13.35.238.19, 13.35.238.61, 2600:9000:2085:3200:f:1ded:6e80:93a1, 2600:9000:2085:4a00:f:1ded:6e80:93a1, 2600:9000:2085:4e00:f:1ded:6e80:93a1, 2600:9000:2085:5600:f:1ded:6e80:93a1, 2600:9000:2085:5800:f:1ded:6e80:93a1, 2600:9000:2085:8400:f:1ded:6e80:93a1, 2600:9000:2085:9200:f:1ded:6e80:93a1, 2600:9000:2085:c600:f:1ded:6e80:93a1
Response IP 13.35.238.61
Found Yes
Hash a3d27b3ca5ce32341fa9f96f01169b521b1657c05d1860c45d1e53a6258e9e8b
SimHash 4854501547f5

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Allow /