Architecture lab

Challenge 1: Scale a web app to 10,000 RPSTarget 10,000 RPS

0% busy
Users
1x inst10,000 RPS
1000% busy
Web server
1x inst10,000 RPS
40% busy
Database
1x inst1,000 RPS

Design summary

Components

  • Users: 1 × Users
  • Web server: 1 × App server, 10,000 requests a second, 1000% busy
  • Database: 1 × Relational database, 1,000 requests a second, 40% busy

Connections

  • Users sends requests to Web server
  • Web server sends requests to Database

1,000 of 10,000 requests a second served, average 178 ms, p99 468 ms, 210 USD a month. Challenge not yet passed: throughput, availability, headroom.