Distribute mission-critical API traffic, LLM token streams, and microservice workloads with sub-millisecond overhead, active health probing, and automated circuit breaking.
version: '3.8'
services:
openbalancer:
image: ghcr.io/incontrolplus/openbalancer:latest
container_name: openbalancer-core
ports:
- "8080:8080"
volumes:
- ./config.json:/app/config.json:ro
environment:
- ROUTING_ALGORITHM=weighted_round_robin
- HEALTH_PROBE_INTERVAL=3
- CIRCUIT_BREAKER_THRESHOLD=5
restart: unless-stopped
Built from the ground up on non-blocking asynchronous sockets with zero external dependencies in the hot path.
Full support for HTTP/1.1, HTTP/2 multiplexing, long-lived WebSockets, Server-Sent Events (SSE), and gRPC streaming.
Detects consecutive 5xx errors or socket timeouts in milliseconds, instantly tripping degraded upstream backends out of the pool.
Select between Weighted Round-Robin, Smooth Least Connections, and Consistent IP Hash Rings for session sticky routing.
Observe how OpenBalancer dynamically distributes socket requests and reroutes traffic when an upstream node fails.
TCP Sockets & Webhooks
Architected specifically for low-overhead async AI inference routing and mission-critical microservice clusters.
| Feature / Capability | OpenBalancer v1.4 | NGINX Community | HAProxy Community | Traefik Proxy |
|---|---|---|---|---|
| Async Non-Blocking Core | ||||
| LLM Token Stream & SSE Passthrough | ||||
| Active Health Probing & Circuit Breaking | ||||
| Memory Footprint (RSS) | ~35 MB | ~25 MB | ~65 MB | |
| Sub-millisecond p99 Routing Overhead | < 0.45 ms | < 0.40 ms | < 0.85 ms | |
| Guaranteed B2B 99.9% Uptime SLA Backing |
Customize your cluster parameters, upstream weights, and health probes with instant JSON validation and 1-click download.
OpenBalancer is backed and operated by INCONTROL PLUS ЕООД. We provide formal B2B Master Services Agreements (MSA), guaranteed 99.9% uptime SLAs, and sub-15 minute emergency incident response for corporate engineering teams.
Contractual SLA with automated service credits for downtime under 99.9%.
24/7 direct escalation hotline to senior infrastructure architects.
EU VAT compliant invoicing processed securely via Stripe Invoicing.
Deploy OpenBalancer for free under the MIT license, or partner with INCONTROL PLUS for guaranteed B2B SLAs.
For developers and self-hosted environments.
For high-availability production clusters.
For multi-region and high-throughput systems.
Everything you need to know regarding licensing, SLA guarantees, invoicing, and technical deployment.
Under our Master Services Agreement (MSA), if your cluster uptime falls below 99.9% in a calendar month, INCONTROL PLUS automatically applies contractual service credits calculated per minute of downtime, credited directly against your next Stripe invoice.
All corporate retainers are invoiced securely through Stripe Invoicing with automated EU VAT reverse-charge calculation. We support SEPA B2B direct bank transfers, corporate cards (Visa, Mastercard, AMEX), and Net-14 payment terms.
OpenBalancer streams chunks directly via zero-copy kernel socket piping and disables internal proxy response buffering for `text/event-stream` and `application/grpc` headers. Memory consumption remains strictly constant (O(1)) regardless of stream length.
Yes. OpenBalancer is 100% self-contained and has zero external telemetry requirements. You can run it as a standalone Linux binary, a Docker container, or inside a Kubernetes cluster completely isolated from the public internet.
We offer a 30-day initial trial window on SLA retainers. If our response times or failover performance do not meet your technical expectations, you can cancel with full refund of the current retainer period.