Architecture lab

Challenge 13: Social graph queriesTarget 10,000 RPS

0% busy
Users
1x inst10,000 RPS
67% busy
Load balancer
3x inst10,000 RPS
63% busy
Graph API
16x inst10,000 RPS
227% busy
Graph shards
16x inst10,000 RPS

Design summary

Components

  • Users: 1 × Users
  • Load balancer: 3 × Load balancer, 10,000 requests a second, 67% busy
  • Graph API: 16 × App server, 10,000 requests a second, 63% busy
  • Graph shards: 16 × NoSQL store, 10,000 requests a second, 227% busy

Connections

  • Users sends requests to Load balancer
  • Load balancer sends requests to Graph API
  • Graph API sends requests to Graph shards

4,414 of 10,000 requests a second served, average 120 ms, p99 287 ms, 2,985 USD a month. Challenge not yet passed: throughput, losing one instance.