Architecture is not merely the study of algorithms and availability; in real-world engineering, architecture is the art of balancing functional requirements against physical and economic constraints. A system that achieves six nines of availability but costs $500,000 per month for a startup with $20,000 in monthly recurring revenue is an architectural failure.

As systems scale from thousands to millions of requests per second, the cloud provider’s pricing topology dictates design decisions:

  • The Network Data Transfer Tax: Why cross-Availability-Zone traffic ($0.01/GB each way) and Internet egress ($0.09/GB) often exceed total EC2 compute bills in distributed streaming (Kafka) and microservice graph architectures.
  • Compute Commitment Economics: Blending On-Demand (100% price), Reserved Instances / Compute Savings Plans (30–60% discount), and Spot / Preemptible Instances (70–90% discount) to achieve maximum reliability at minimal cost.
  • Storage Tier Lifecycles: Designing automated transitions between Hot SSD (NVMe / io2), Warm Object Storage (S3 Standard), Infrequent Access (S3-IA), and Cold Archive (S3 Glacier / Deep Archive).

This module bridges technical systems architecture with financial engineering, providing the tools to calculate Total Cost of Ownership (TCO) and optimize unit economics at scale.

What you will learn

  • Deconstruct cloud billing models: Compute (On-Demand, Savings Plans, Spot), Storage tiers, and cross-AZ/Internet data transfer costs
  • Eliminate multi-thousand dollar 'network egress tax' traps through VPC Endpoints, topology-aware routing, and co-locality
  • Architect resilient, cost-optimal Spot fleet workloads with automated graceful termination draining and fallback
  • Formulate unit economic metrics (/Monthly Active User, $/GB Transacted) to guide architectural design reviews
STAGE TOPICS

Topics in this chapter