cleared.io
robots.txt

Robots Exclusion Standard data for cleared.io

Resource Scan

Scan Details

Site Domain cleared.io
Base Domain cleared.io
Scan Status Ok
Last Scan2025-05-31T10:20:46+00:00
Next Scan 2025-06-14T10:20:46+00:00

Last Scan

Scanned2025-05-31T10:20:46+00:00
URL https://cleared.io/robots.txt
Domain IPs 104.26.6.225, 104.26.7.225, 172.67.71.150, 2606:4700:20::681a:6e1, 2606:4700:20::681a:7e1, 2606:4700:20::ac43:4796
Response IP 104.26.6.225
Found Yes
Hash e91dc9fab124dce81802f9410ee970a56346ab2aa9530dba92d173527b580b64
SimHash e8045c5401d1

Groups

*

Rule Path
Disallow /step1challenge

Other Records

Field Value
sitemap http://cleared.io/sitemap.xml