System design · Advanced · 45 min
Delivery analytics with late and repeated events
Serve live operations and corrected finance reports from one event history.
Task
Design a delivery analytics pipeline receiving 200 events per second on average and peaks of 1,000. Operations needs delivery counts within a minute. Finance needs validated daily revenue. Devices resend messages and may upload events several days late.
Requirements
- Include durable ingestion, replay, event-time processing, and validated publication.
- Separate provisional live results from corrected daily totals.
- Explain duplicate handling, late corrections, job recovery, and a failed release.
- Draw input/output, expanded components, and the deployment pipeline.
StreamingEvent timeReliabilityBatch versus streaming
Loading exercise…