Architecture

From client to committed ledger without a single unnecessary copy.

gRPC streaming enters Go services, crosses into the Rust engine over TCP + MessagePack, lands on a lock-free LMAX Disruptor, and commits to TigerBeetle through VSR with O_DIRECT storage semantics. The same transport discipline now also underpins priority routing, cross-shard 2PC, and distributed AI inference.

ClientgRPC StreamGo Services256 in-flightzero RTTRust EngineLMAX Disruptor84ns P99TigerBeetleVSR · 3-node~1.6ms/roundLedgerio_uring · ACIDACIDgRPC streamTCP / io_uringBatch 100×VSR consensus

01

gRPC Bidirectional Streaming

Persistent connections with 256 in-flight requests per stream eliminate TCP handshake overhead on every transaction. The channel stays open; only the data moves.

02

TCP + MessagePack Handoff

Go services forward validated traffic into the Rust engine over a compact framed transport so the control plane stays explicit and the hot path stays lean.

03

LMAX Disruptor Ring Buffer

A single-producer lock-free ring buffer processes events at 84ns P99 latency — faster than a CPU cache miss. No locks means no contention, and no contention means linear scaling.

04

Cross-Shard 2PC

TigerBeetle pending, post, and void flows enable atomic reserve-and-commit behavior across shards instead of leaving distributed transfer correctness to application code.

05

Priority Routing

Independent Aeron streams let critical events target <1ms latency while high and normal traffic keep their own backpressure and fairness guarantees.

06

TigerBeetle VSR + io_uring

Viewstamped Replication across three nodes provides fault tolerance while io_uring keeps the storage path tight enough for both fintech and AI workloads to share the same operating model.

Full Stack

Layer
Technology
Purpose
Engine
Rust + LMAX Disruptor
Lock-free ring buffer · 262K capacity/shard · 42ns P99
Services
Go + gRPC streaming
Persistent streams · 256 in-flight window · zero RTT ingress
Transport
TCP + MessagePack · io_uring · Aeron IPC
1.2M TPS local · zero-copy IPC · sub-ms hot path
Ledger
TigerBeetle 0.16.78
VSR consensus · O_DIRECT disk writes · ACID
Pipeline
2 shards/node · 131K in-flight
Horizontal scaling · 97.7% efficiency at 2 shards
Cross-Shard 2PC
TigerBeetle pending/post/void
Atomic cross-shard transfers with reserve, commit, and abort paths
Priority Routing
Multi-stream Aeron
Critical <1ms · High <5ms · Normal <50ms · independent backpressure
Replication
VSR · quorum 2/3
Survives 1-node failure · no split-brain
AI / ML
Tract ONNX · 5 datasets · Qwen2.5-7B
Pure Rust inference · distributed LLM pipeline · dataset-agnostic transport
Infra
Docker + Ansible · Kubernetes
Reproducible clusters · ingress hardening · multi-environment ops
Observability
Prometheus + Grafana + OTel
Real-time metrics · distributed tracing
Security
Vault + Keycloak + OPA + cert-manager
Secrets · auth · policy · mTLS auto-rotation
Supply Chain
Syft SBOM + Cosign
Keyless image signing · provenance attestations in CI