Architecture lab

Challenge 7: Upload events with burstsTarget 3,000 RPS

0% busy
Uploaders
1x inst3,000 RPS
30% busy
Load balancer
2x inst3,000 RPS
50% busy
Upload API
6x inst3,000 RPS
120% busy
Database
2x inst3,000 RPS

Design summary

Components

  • Uploaders: 1 × Users
  • Load balancer: 2 × Load balancer, 3,000 requests a second, 30% busy
  • Upload API: 6 × App server, 3,000 requests a second, 50% busy
  • Database: 2 × Relational database, 3,000 requests a second, 120% busy

Connections

  • Uploaders sends requests to Load balancer
  • Load balancer sends requests to Upload API
  • Upload API sends requests to Database

2,500 of 3,000 requests a second served, average 198 ms, p99 568 ms, 730 USD a month. Challenge not yet passed: throughput, losing one instance, burst.