Architecture lab

Challenge 15: Sales rank by categoryTarget 30,000 RPS

0% busy
Shoppers
1x inst30,000 RPS
100% busy
Load balancer
6x inst30,000 RPS
94% busy
Rank API
32x inst30,000 RPS
156% busy
Rank cache
4x inst30,000 RPS
40% busy
Sales store
4x inst2,534 RPS

Design summary

Components

  • Shoppers: 1 × Users
  • Load balancer: 6 × Load balancer, 30,000 requests a second, 100% busy
  • Rank API: 32 × App server, 30,000 requests a second, 94% busy
  • Rank cache: 4 × Cache, 30,000 requests a second, 156% busy
  • Sales store: 4 × NoSQL store, 2,534 requests a second, 40% busy

Connections

  • Shoppers sends requests to Load balancer
  • Load balancer sends requests to Rank API
  • Rank API sends requests to Rank cache
  • Rank cache sends requests to Sales store
  • Rank API sends requests to Sales store

23,250 of 30,000 requests a second served, average 64 ms, p99 111 ms, 2,930 USD a month. Challenge not yet passed: throughput, losing one instance.