Architecture lab

Challenge 9: Pastebin at scaleTarget 5,000 RPS

0% busy
Users
1x inst5,000 RPS
50% busy
Load balancer
2x inst5,000 RPS
63% busy
Paste API
8x inst5,000 RPS
200% busy
Database
2x inst5,000 RPS

Design summary

Components

  • Users: 1 × Users
  • Load balancer: 2 × Load balancer, 5,000 requests a second, 50% busy
  • Paste API: 8 × App server, 5,000 requests a second, 63% busy
  • Database: 2 × Relational database, 5,000 requests a second, 200% busy

Connections

  • Users sends requests to Load balancer
  • Load balancer sends requests to Paste API
  • Paste API sends requests to Database

2,500 of 5,000 requests a second served, average 198 ms, p99 568 ms, 10,050 USD a month. Challenge not yet passed: throughput, monthly cost, losing one instance.