Architecture lab

Challenge 3: A media portal for users worldwideTarget 30,000 RPS · average ≤ 70 ms

0% busy
Users worldwide
1x inst30,000 RPS
300% busy
Load balancer
2x inst30,000 RPS
105% busy
App servers
10x inst10,000 RPS
379% busy
Database
2x inst9,482 RPS

Design summary

Components

  • Users worldwide: 1 × Users
  • Load balancer: 2 × Load balancer, 30,000 requests a second, 300% busy
  • App servers: 10 × App server, 10,000 requests a second, 105% busy
  • Database: 2 × Relational database, 9,482 requests a second, 379% busy

Connections

  • Users worldwide sends requests to Load balancer
  • Load balancer sends requests to App servers
  • App servers sends requests to Database

2,500 of 30,000 requests a second served, average 300 ms, p99 761 ms, 970 USD a month. Challenge not yet passed: throughput, average latency, losing one instance.