Architecture lab

Challenge 10: Home timelines at scaleTarget 20,000 RPS

0% busy
Users
1x inst20,000 RPS
100% busy
Load balancer
4x inst20,000 RPS
83% busy
Timeline service
24x inst20,000 RPS
11600% busy
Post database
2x inst290,000 RPS

Design summary

Components

  • Users: 1 × Users
  • Load balancer: 4 × Load balancer, 20,000 requests a second, 100% busy
  • Timeline service: 24 × App server, 20,000 requests a second, 83% busy
  • Post database: 2 × Relational database, 290,000 requests a second, 11600% busy

Connections

  • Users sends requests to Load balancer
  • Load balancer sends requests to Timeline service
  • Timeline service sends requests to Post database

172 of 20,000 requests a second served, average 218 ms, p99 588 ms, 1,880 USD a month. Challenge not yet passed: throughput, losing one instance.