trades, order books, liquidations, funding and prediction markets from binance, bybit, okx, hyperliquid and polymarket — captured at the socket by a single-core rust engine, consolidated to R2, ready for pandas.
ten datasets across binance, bybit, okx, hyperliquid and polymarket — spot, perps and prediction markets
every row carries the exchange timestamp and a microsecond socket-receive timestamp. files are hive-partitioned by date, hour, message type, instrument, exchange and symbol.
every file on this site is produced by a rust engine doing the hard part — connect, parse, dedup, timestamp, persist — with zero allocations and no locks on the hot path. one instance absorbs 200k messages a second; the whole service is four €19/month collector boxes and a consolidator. scaling through a market meltdown means adding a box, not rewriting — and every row carries a microsecond socket timestamp instead of a gateway guess.
the engine isn't for sale. today, it only powers this site.