Architecture lab

Challenge 8: Checkout with a slow dependencyTarget 3,000 RPS

0% busy
Shoppers
1x inst3,000 RPS
30% busy
Load balancer
2x inst3,000 RPS
50% busy
Storefront service
6x inst3,000 RPS
6% busy
Catalog cache
3x inst2,100 RPS
30% busy
Inventory service
3x inst900 RPS
49% busy
Database
2x inst1,215 RPS

Design summary

Components

  • Shoppers: 1 × Users
  • Load balancer: 2 × Load balancer, 3,000 requests a second, 30% busy
  • Storefront service: 6 × App server, 3,000 requests a second, 50% busy
  • Catalog cache: 3 × Cache, 2,100 requests a second, 6% busy
  • Inventory service: 3 × App server, 900 requests a second, 30% busy
  • Database: 2 × Relational database, 1,215 requests a second, 49% busy

Connections

  • Shoppers sends requests to Load balancer
  • Load balancer sends requests to Storefront service
  • Storefront service sends requests to Catalog cache
  • Catalog cache sends requests to Database
  • Storefront service sends requests to Inventory service
  • Inventory service sends requests to Database

3,000 of 3,000 requests a second served, average 31 ms, p99 89 ms, 1,150 USD a month. Challenge not yet passed: slow dependency.