Topic

Cloud Observability, Performance & Operations

Running a shared platform once customers depend on it: per-tenant visibility, fair background work, online migrations, availability reporting, and cost.

These guides cover the day-to-day operation of a multi-tenant platform. Most of their labs are simulations with every parameter in the code, so you can replace the invented traffic with a day or a month of your own and rerun them. If you only read one, read the job queue guide: its lab shows a commonly published scheduler that never served a second tenant and then stopped entirely.

Suggested reading order

  1. Tenant-Aware Observability with OpenTelemetry: Baggage, Spans, and Metric Cardinality

    Find one tenant's slow requests in traces and logs without exploding metric cardinality.

    Lab finding: None by default, although the header reached the downstream service. With a span processor copying tenant.id from baggage, all three spans carried it.

  2. Fair Background Job Queues for Multi-Tenant Systems: Testing Deficit Round-Robin

    Keep one tenant's batch from delaying everyone else's background jobs.

    Lab finding: FIFO: 24.9 s. The published dispatcher never ran the other tenants' jobs and then looped forever. Corrected DRR: 40 ms.

  3. PostgreSQL Schema Changes Without Downtime: Locks, the Lock Queue, and Expand-Contract

    Change the schema without letting a waiting lock stall the application.

    Lab finding: No lock_timeout: 7,500 of 12,000 queries failed. A 500 ms lock_timeout with retries: none failed, worst wait 490 ms, migration done 2.5 s after the report.

  4. Status Pages and SLA Reporting: Independent Hosting, Real Probes, and Gap-Free Credit Tables

    Detect outages the way customers see them and measure availability as the contract defines it.

    Lab finding: At 99.9%, February allows 40 min 19 s and 31-day months 44 min 38 s. Bands '99.0-99.89%' and '99.9-100%' matched nothing for 2,600 to 2,851 s of monthly downtime.

  5. Per-Tenant Cost Attribution on Shared Infrastructure: Rules, Idle Capacity, and Reconciliation

    Attribute shared infrastructure cost to tenants with rules you can defend.

    Lab finding: One tenant ranged from a 54% margin to -245%. An equal split showed small tenants at -40% as a group. Keeping idle capacity separate removed $11,400 from tenant costs.

Put numbers on it: Multi-Tenant Capacity Planner

All guides in this topic