OpenBalancer Logo OpenBalancer
Core Engine: Async Socket Event Loop v1.4.0-stable MIT License

High-Throughput Asynchronous Load Balancer & Reverse Proxy

Distribute mission-critical API traffic, LLM token streams, and microservice workloads with sub-millisecond overhead, active health probing, and automated circuit breaking.

240,000 Req / Sec Throughput
< 0.38 ms p99 Routing Latency
65,535 Max Concurrent Conns
18 MB Core RSS Footprint
version: '3.8'
services:
  openbalancer:
    image: ghcr.io/incontrolplus/openbalancer:latest
    container_name: openbalancer-core
    ports:
      - "8080:8080"
    volumes:
      - ./config.json:/app/config.json:ro
    environment:
      - ROUTING_ALGORITHM=weighted_round_robin
      - HEALTH_PROBE_INTERVAL=3
      - CIRCUIT_BREAKER_THRESHOLD=5
    restart: unless-stopped

Engineered for High-Concurrency Protocols

Built from the ground up on non-blocking asynchronous sockets with zero external dependencies in the hot path.

Protocol Agnostic Routing

Full support for HTTP/1.1, HTTP/2 multiplexing, long-lived WebSockets, Server-Sent Events (SSE), and gRPC streaming.

Active Circuit Breaking

Detects consecutive 5xx errors or socket timeouts in milliseconds, instantly tripping degraded upstream backends out of the pool.

Multi-Algorithm Balancing

Select between Weighted Round-Robin, Smooth Least Connections, and Consistent IP Hash Rings for session sticky routing.

Live Traffic & Failover Visualizer

Observe how OpenBalancer dynamically distributes socket requests and reroutes traffic when an upstream node fails.

Live Real-Time Ingress Telemetry (Prometheus Metric Stream)
LIVE STREAM
Real-Time Latency Heatmap & Flamegraph DYNAMIC 60FPS
p501.2ms
p908.4ms
p9914.1ms
p99.926.8ms
<10ms (Optimal) 82%
10-50ms (Normal) 14%
50-200ms (Spike) 3%
>200ms (Degraded) 1%
Active Protocol Stream: HTTP/1.1 (Keep-Alive)
Processed Requests 142,850
Observed Latency 12 ms
Dispatched Node srv-us-east-1
Active Protocol HTTP/1.1
Cluster Status: All 3 upstream nodes online. Dynamic load distribution active.
200 OK (Healthy)
500ms Latency Spike (Degraded)
Node Outage / Circuit Breaker Drop
Tip: Click canvas or send requests to spawn live particle streams
INGRESS

Client Ingestion

TCP Sockets & Webhooks

Port 443 • TLS 1.3
ASYNC ROUTER

OpenBalancer Core

Weighted Round-Robin
Non-Blocking Epoll
srv-us-east-1
AI Model Cluster A (Weight: 2)
HEALTHY
srv-eu-west-1
API Primary Node (Weight: 1)
HEALTHY
srv-ap-southeast-1
Failover Redundancy Pool
HEALTHY

OpenBalancer vs Traditional Edge Proxies

Architected specifically for low-overhead async AI inference routing and mission-critical microservice clusters.

Feature / Capability OpenBalancer v1.4 NGINX Community HAProxy Community Traefik Proxy
Async Non-Blocking Core ✓ Zero-Copy Epoll ✓ Worker Pool ✓ Event-driven ✓ Go Goroutines
LLM Token Stream & SSE Passthrough ✓ Native Zero-Buffer Requires Buffering Tuning ✓ Supported ✓ Supported
Active Health Probing & Circuit Breaking ✓ Built-in Free NGINX Plus Only ($$$) ✓ Basic Probes ✓ Built-in
Memory Footprint (RSS) ~18 MB ~35 MB ~25 MB ~65 MB
Sub-millisecond p99 Routing Overhead < 0.38 ms < 0.45 ms < 0.40 ms < 0.85 ms
Guaranteed B2B 99.9% Uptime SLA Backing ✓ INCONTROL PLUS MSA Community Support Enterprise Only Enterprise Only

Cluster Configuration Generator

Customize your cluster parameters, upstream weights, and health probes with instant JSON validation and 1-click download.

Health Check Interval 3s
Circuit Breaker Threshold 5 fails
Socket Connection Timeout 250ms
openbalancer.json (Validated JSON)

Production Infrastructure & SLA Management

OpenBalancer is backed and operated by INCONTROL PLUS ЕООД. We provide formal B2B Master Services Agreements (MSA), guaranteed 99.9% uptime SLAs, and sub-15 minute emergency incident response for corporate engineering teams.

99.9% Uptime Guarantee

Contractual SLA with automated service credits for downtime under 99.9%.

Sub-15 Min Critical Incident SLA

24/7 direct escalation hotline to senior infrastructure architects.

Net-14 Corporate Invoicing

EU VAT compliant invoicing processed securely via Stripe Invoicing.

Transparent Licensing & B2B Support Tiers

Deploy OpenBalancer for free under the MIT license, or partner with INCONTROL PLUS for guaranteed B2B SLAs.

Community Open-Source

For developers and self-hosted environments.

€0 / forever
  • Full Core Routing Engine (MIT)
  • Round-robin & Weighted Algorithms
  • Active Health Probing & Metrics
  • Docker Swarm & K8s Support
Download Community Core

Custom Enterprise SLA

For multi-region and high-throughput systems.

Custom / retainer
  • Custom Master Services Agreement (MSA)
  • Custom AI LLM Dispatcher Plugins
  • Dedicated Senior DevOps Lead
  • Net-30 Corporate Terms

Frequently Asked Questions

Everything you need to know regarding licensing, SLA guarantees, invoicing, and technical deployment.

Under our Master Services Agreement (MSA), if your cluster uptime falls below 99.9% in a calendar month, INCONTROL PLUS automatically applies contractual service credits calculated per minute of downtime, credited directly against your next Stripe invoice.

All corporate retainers are invoiced securely through Stripe Invoicing with automated EU VAT reverse-charge calculation. We support SEPA B2B direct bank transfers, corporate cards (Visa, Mastercard, AMEX), and Net-14 payment terms.

OpenBalancer streams chunks directly via zero-copy kernel socket piping and disables internal proxy response buffering for `text/event-stream` and `application/grpc` headers. Memory consumption remains strictly constant (O(1)) regardless of stream length.

Yes. OpenBalancer is 100% self-contained and has zero external telemetry requirements. You can run it as a standalone Linux binary, a Docker container, or inside a Kubernetes cluster completely isolated from the public internet.

We offer a 30-day initial trial window on SLA retainers. If our response times or failover performance do not meet your technical expectations, you can cancel with full refund of the current retainer period.

Secured B2B Invoicing & Retainers Encrypted 256-bit TLS payments processed via Stripe with Net-14 corporate invoicing terms.
VISA MASTERCARD AMEX SEPA STRIPE VERIFIED