Two more sites stop fetching for themselves today. advis0r.com built every research report on four hundred days of Alpaca bars, the company's SEC facts and Alpaca's asset list; b1dz.com asked CoinGecko and four exchanges every five minutes which pairs exist and what they did. nichedb.dev 0.8 keeps all of it once, and both sites read it there.
What moved, and what did not
Not everything a trading site does is a feed. b1dz's WebSocket tickers, its two-second arbitrage ticks, its private broker and exchange accounts, its DEX quotes and its DealDash session stay where they are; so do advis0r's signal extraction, corroboration, scoring, speech-to-text and the LLM analysis. What moved is the data both sites, and any site like them, need the same copy of.
nichedb 0.8
The symbol directory. alpaca-assets keeps every tradable US equity and crypto asset Alpaca lists, about 14,400 rows, refreshed daily. Feed: us-symbols.
Price history. equity-history keeps one item a symbol carrying its last four hundred daily bars, appended after each session settles from the multi-symbol bars endpoint, about ninety requests an evening for 12,900 symbols. An adapter can read its own previous items back now, so a window is kept, not rebuilt. Feed: price-history.
Fundamentals. sec-fundamentals walks every SEC filer's XBRL facts once a week at five requests a second: revenue, income, EPS, assets, liabilities, cash, operating cash flow, shares, from 10-K, 10-Q, 20-F and 40-F, the last twelve points of each. Feed: fundamentals.
The crypto universe. A new crypto collection: coingecko-assets (the top 500 by market cap every quarter hour) and crypto-pairs (every spot pair on Kraken, Coinbase, Binance.US and Gemini with its 24-hour ticker, every five minutes, one row a pair a venue, 2,190 of them). The doc says where each venue is odd: Kraken's daily open is midnight UTC, Gemini publishes no volume on any all-pairs endpoint, Coinbase has no bid or ask. Feeds: usd-pairs, top-100.
Two things found on the way. A source seeded off because its key was missing stayed off after the key arrived, since the seed never touched the flag; the Alpaca corporate-actions source had sat at zero items for that reason, and now has 6,400. And the seed judged a source's needs against a slice of the config that did not hold the contact email the SEC wants in a user agent. Both fixed.
The sites
advis0r.com runs with NICHEDB_MARKETS=1: a report build reads the symbol's history item and the company's fundamentals item, two requests, and falls back to the live path when either is missing or stale; the symbol sync walks the directory by cursor; a ticker's news refresh reads nichedb's market news wire before the RSS feeds. Fresh reports record their bars source, and today's say nichedb.
b1dz.com runs with NICHEDB_CRYPTO=1 and NICHEDB_MARKETS=1: pair discovery reads the dollar-quoted pairs and the assets from nichedb, eleven requests every five minutes instead of six calls to five hosts, and applies the same rules, two venues or more with fifty thousand dollars a day on each and ten million of market cap; backtests read the history item and fall back to Yahoo when the window is longer than it. Its first discovery pass from nichedb picked 150 pairs from 1,582 rows.
That makes five sites on nichedb: tipoffwatch, genrewatch, bittorrented, advis0r and b1dz, plus nixamp. The contract for each collection is one document in the repo.
nichedb: https://nichedb.dev.
Top comments (0)