Internet of Things (IoT) & Embedded Systems Architecture
MQTT Cluster Scale Architecture
MQTT is the default protocol for constrained devices because it is lightweight and supports publish-subscribe semantics. Scaling to millions of connections is a broker and infrastructure problem: session state, topic design, and backpressure decide whether the cluster stays stable. EMQX and Mosquitto sit at different points on the scale curve.
Key points
- Design topic hierarchies around access control and subscription patterns, not device IDs alone.
- Use persistent sessions only where offline delivery is genuinely required.
- Size connection handling and message throughput separately, since they stress different resources.
- Apply rate limits and backpressure per client to protect the broker.
- Terminate TLS at the broker or a load balancer and measure the CPU cost.
- Monitor queue depth, dropped messages, and reconnect storms.
- Test failover with real device reconnect behavior, which can amplify load.
- Keep payloads small and schema-versioned.
Frequently asked questions
How many clients can one broker handle?
It depends on message rate and hardware. Clustering is required well before theoretical connection limits.
Should I use QoS 2 everywhere?
No. It adds overhead and is rarely necessary for telemetry.
How do I handle reconnect storms?
Add jitter, backoff, and broker-side throttling.
Is Mosquitto enough at scale?
For moderate fleets yes. Very large deployments usually need a clustered broker.
How Kinetikatech helps with internet of things (iot) & embedded systems architecture
You shouldn't have to become an expert in internet of things (iot) & embedded systems architecture: Edge gateways, real-time operating systems, signed firmware updates, and power budgets, the engineering that keeps constrained devices correct for years without a technician on site. That's exactly what Server Management and Linux Server Security is for, setup, hardening, monitoring, and a human on call day and night.