stockbit.io
robots.txt

Robots Exclusion Standard data for stockbit.io

Resource Scan

Scan Details

Site Domain stockbit.io
Base Domain stockbit.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-29T23:43:27+00:00
Next Scan 2026-02-27T23:43:27+00:00

Last Successful Scan

Scanned2025-10-23T01:25:48+00:00
URL https://stockbit.io/robots.txt
Domain IPs 13.33.88.102, 13.33.88.117, 13.33.88.125, 13.33.88.46, 2600:9000:223b:7200:7:9780:b9c0:93a1, 2600:9000:223b:7800:7:9780:b9c0:93a1, 2600:9000:223b:7a00:7:9780:b9c0:93a1, 2600:9000:223b:9e00:7:9780:b9c0:93a1, 2600:9000:223b:a800:7:9780:b9c0:93a1, 2600:9000:223b:c00:7:9780:b9c0:93a1, 2600:9000:223b:cc00:7:9780:b9c0:93a1, 2600:9000:223b:fe00:7:9780:b9c0:93a1
Response IP 13.33.88.46
Found Yes
Hash 463a650df0c8bc0c82b3ec1d1e25ea6763125e53cf897f53701fbbca8f4d2790
SimHash bc943070d9f5

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /assets/
Disallow /charting/
Disallow /build/
Disallow /mockups/
Disallow /system/
Disallow /node_modules/
Disallow /upload/
Disallow /company/chartTimeSpan/
Disallow /company/indexes/
Disallow /fundachart.html

twitterbot

Rule Path
Allow /assets/img/
Allow /
Allow /symbol/*
Allow /post/*

Other Records

Field Value
sitemap http://sitemap.stockbit.com/stockbit.symbol.xml
sitemap http://sitemap.stockbit.com/stockbit.stream.xml

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /assets/img are shared.