Architecture lab

Challenge 5: IoT telemetry ingestionTarget 30,000 RPS

0% busy
Devices
1x inst30,000 RPS
150% busy
Load balancer
4x inst30,000 RPS
50% busy
Ingest servers
40x inst20,000 RPS
800% busy
Database
2x inst20,000 RPS

Design summary

Components

  • Devices: 1 × Users
  • Load balancer: 4 × Load balancer, 30,000 requests a second, 150% busy
  • Ingest servers: 40 × App server, 20,000 requests a second, 50% busy
  • Database: 2 × Relational database, 20,000 requests a second, 800% busy

Connections

  • Devices sends requests to Load balancer
  • Load balancer sends requests to Ingest servers
  • Ingest servers sends requests to Database

2,500 of 30,000 requests a second served, average 216 ms, p99 586 ms, 2,840 USD a month. Challenge not yet passed: throughput, losing one instance.