token.unlocks.app
robots.txt

Robots Exclusion Standard data for token.unlocks.app

Resource Scan

Scan Details

Site Domain token.unlocks.app
Base Domain unlocks.app
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-19T11:49:08+00:00
Next Scan 2025-10-03T11:49:08+00:00

Last Successful Scan

Scanned2025-08-12T10:29:29+00:00
URL https://token.unlocks.app/robots.txt
Redirect https://tokenomist.ai/robots.txt
Redirect Domain tokenomist.ai
Redirect Base tokenomist.ai
Domain IPs 104.20.38.132, 172.66.145.251, 2606:4700:10::6814:2684, 2606:4700:10::ac42:91fb
Redirect IPs 104.20.36.234, 172.66.155.227, 2606:4700:10::6814:24ea, 2606:4700:10::ac42:9be3
Response IP 172.66.155.227
Found Yes
Hash 4aaf8d9100f026b239ffa5aa7562570e94b9b17540981ce65bc7a714b72e9f18
SimHash e00ccb43c3b5

Groups

*

Rule Path
Allow /*
Disallow /api/*

ccbot
omgilibot
omgili
diffbot
imagesiftbot
cohere-ai

Rule Path
Disallow /