DEV Community

Haidar S. Ali
Haidar S. Ali

Posted on

Open Source ๐“๐ซ๐š๐๐ข๐ง๐  ๐’๐ข๐ ๐ง๐š๐ฅ ๐’๐ž๐ซ๐ฏ๐ž๐ซ

LLMs can become useful analysis assistants when they have structured data and realโ€‘time market context, meaning they have enough relevant information for the task.
Getting specific indicators, news, and candles into an LLM is difficult, even with search tools integrated. You still need structured inputs, the right context, and a way to ensure everything the model receives is accurate and relevant.
For this reason, I built a system that prepares and delivers all required market data to LLMs in a clean, structured, and consistent format.
I'm excited to share my ๐“๐ซ๐š๐๐ข๐ง๐  ๐’๐ข๐ ๐ง๐š๐ฅ ๐’๐ž๐ซ๐ฏ๐ž๐ซ, a researchโ€‘driven system for developing and evaluating crypto signals with LLMs, quantitative models, and historical data.
๐—ž๐—ฒ๐˜† ๐—ณ๐—ฒ๐—ฎ๐˜๐˜‚๐—ฟ๐—ฒ๐˜€
โ€ข ๐—•๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ฒ ๐—บ๐—ฎ๐—ฟ๐—ธ๐—ฒ๐˜ ๐—ฑ๐—ฎ๐˜๐—ฎ including candles, orderโ€‘book metrics, recent trades, and technical indicators
โ€ข ๐—ช๐—ฒ๐—ฏโ€‘๐˜€๐—ฒ๐—ฎ๐—ฟ๐—ฐ๐—ต ๐—ฐ๐—ผ๐—ป๐˜๐—ฒ๐˜…๐˜ for crypto news, whale activity, policy, macro events, exchange updates, and whale alerts
โ€ข ๐—ข๐—ฝ๐—ฒ๐—ป๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ๐—ฟ ๐—บ๐—ผ๐—ฑ๐—ฒ๐—น ๐˜€๐—ฒ๐—น๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป for choosing free or paid models from OpenAI, Google, Anthropic, Mistral, and others
โ€ข ๐—Ÿ๐—Ÿ๐—  ๐˜ƒ๐—ผ๐˜๐—ถ๐—ป๐—ด and repeated iterations for consistency checks
โ€ข ๐—ฃ๐—ฟ๐—ผ๐—บ๐—ฝ๐˜ ๐—ณ๐—ถ๐—น๐—ฒ๐˜€ mapped to models and iteration cycles
โ€ข ๐—ค๐˜‚๐—ฎ๐—ป๐˜ ๐—บ๐—ผ๐—ฑ๐—ฒ๐—น๐˜€ for additional market evidence, with selected model families running in parallel
โ€ข ๐—›๐—ถ๐˜€๐˜๐—ผ๐—ฟ๐—ถ๐—ฐ๐—ฎ๐—น ๐—ฏ๐—ฎ๐—ฐ๐—ธ๐˜๐—ฒ๐˜€๐˜๐—ถ๐—ป๐—ด before live signal analysis
โ€ข ๐—ฃ๐—ฒ๐—ฟ๐—ณ๐—ผ๐—ฟ๐—บ๐—ฎ๐—ป๐—ฐ๐—ฒ ๐—บ๐—ฒ๐˜๐—ฟ๐—ถ๐—ฐ๐˜€ including win rate, returns, drawdown, profit factor, buyโ€‘andโ€‘hold comparison, outperformance, LLM agreement, direction accuracy, confidence calibration, and cost
โ€ข ๐—ง๐—ฒ๐—น๐—ฒ๐—ด๐—ฟ๐—ฎ๐—บ ๐—ฎ๐—น๐—ฒ๐—ฟ๐˜๐˜€ for qualifying signals
โ€ข ๐—ฆ๐—ฎ๐˜ƒ๐—ฒ๐—ฑ ๐—ฐ๐—ผ๐—ป๐—ณ๐—ถ๐—ด๐˜‚๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐˜€ and prompt files for reproducible experiments
โ€ข ๐—ฆ๐—ฒ๐—น๐—ณโ€‘๐—น๐—ฎ๐—ฏ๐—ฒ๐—น๐—ถ๐—ป๐—ด ๐— ๐—Ÿ ๐—ฑ๐—ฎ๐˜๐—ฎ๐˜€๐—ฒ๐˜ signals are saved automatically, and the system later checks real future candles to label each one, giving you clean groundโ€‘truth data for future agent training
โ€ข ๐—Ÿ๐—ผ๐—ฐ๐—ฎ๐—น ๐—ฑ๐—ฎ๐˜€๐—ต๐—ฏ๐—ผ๐—ฎ๐—ฟ๐—ฑ for live signal analysis, testing, configurations, prompts, settings, logs, and ML data

The platform is designed for continuous research, experimentation, and strategy improvement. It generates signals and alerts but does not place exchange orders automatically.
๐Ÿ”— Project: https://github.com/haidarali0/Trading-Signal-Server

Top comments (1)

Collapse
 
_5c75b1d3a1b3628dec81_58 profile image
Yoshiyuku •

Hey Haidar, this resonates a lot โ€” I've been building in a similar space (an AI DeFi agent using Coinbase AgentKit + x402 micropayments on Base, a Uniswap V4 trading agent with a GAN/teacher-student distillation pipeline, and a trade-copier EA), and the "structured data + real-time context is the actual bottleneck, not the LLM itself" problem is exactly what I kept running into too.

Your LLM voting + historical backtesting setup is the piece I haven't solved as cleanly โ€” I ended up going the distillation route (large teacher model โ†’ fine-tuned small student) partly to sidestep exactly the consistency problem voting is trying to address at inference time. Have you compared voting-across-models against something like that, or found voting to be cheaper/more reliable in practice for signal generation specifically?

Also, on the order-book/candle side โ€” are you pulling those live per-signal, or snapshotting and caching on an interval? With Binance data specifically, I've hit issues where indicator values computed just before vs. just after a candle close diverge enough to flip a signal, and I'm curious whether your LLM voting step absorbs that noise or whether it's still sensitive to it.