tokenomist.ai
robots.txt

Robots Exclusion Standard data for tokenomist.ai

Resource Scan

Scan Details

Site Domain tokenomist.ai
Base Domain tokenomist.ai
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-12T20:52:24+00:00
Next Scan 2025-10-12T20:52:24+00:00

Last Successful Scan

Scanned2025-08-14T16:43:43+00:00
URL https://tokenomist.ai/robots.txt
Domain IPs 104.20.36.234, 172.66.155.227, 2606:4700:10::6814:24ea, 2606:4700:10::ac42:9be3
Response IP 104.20.36.234
Found Yes
Hash 4aaf8d9100f026b239ffa5aa7562570e94b9b17540981ce65bc7a714b72e9f18
SimHash e00ccb43c3b5

Groups

*

Rule Path
Allow /*
Disallow /api/*

ccbot
omgilibot
omgili
diffbot
imagesiftbot
cohere-ai

Rule Path
Disallow /