tokenstats.io
robots.txt

Robots Exclusion Standard data for tokenstats.io

Resource Scan

Scan Details

Site Domain tokenstats.io
Base Domain tokenstats.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-08-23T12:40:44+00:00
Next Scan 2025-10-22T12:40:44+00:00

Last Successful Scan

Scanned2025-05-30T15:24:31+00:00
URL https://tokenstats.io/robots.txt
Domain IPs 104.21.44.67, 172.67.196.115, 2606:4700:3030::6815:2c43, 2606:4700:3030::ac43:c473
Response IP 172.67.196.115
Found Yes
Hash ae0bc5e553c1181fec1e0e85c6297f30768f948d39a19cf541fd3ec96abce479
SimHash 8b1ecc73e716

Groups

*

Rule Path
Disallow /user_content/*
Disallow /user_content/
Disallow /an/*
Disallow /an/
Disallow /out/*
Disallow /out/
Disallow /ajax/
Disallow /ajax/*

ia_archiver

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

looksmart

Rule Path
Disallow /

webzip

Rule Path
Disallow /