Universal Containers (UC)uses Apache Kafka on Heroku to stream shipment inventory data in real time throughout the world. A Kafka topic is used to send messages with updates on the shipping container GPS coordinates as they are in transit. UC is using a Heroku Kafka basic-0 plan.The topic was provisioned with 8 partitions, 1 week of retention, and no compaction. The keys for the events are being assigned by Heroku Kafka, which means that they will be randomly distributed between the partitions.
UC has a single-dyno consumer application that persists the data to their Enterprise Data Warehouse (EDW). Recently, they've been noticing data loss in the EDW.
What should an Architect with Kafka experience recommend?
Alton
3 months agoVi
3 months agoJustine
4 months agoDeandrea
4 months agoLeslee
4 months agoChantell
4 months agoCecily
4 months agoSon
5 months agoEleni
5 months agoChristiane
5 months agoRashida
5 months agoKirk
5 months agoSang
10 months agoOra
8 months agoLore
8 months agoRossana
8 months agoJunita
8 months agoBarabara
9 months agoNan
9 months agoZoila
10 months agoStefanie
8 months agoArgelia
9 months agoHoward
10 months agoKenneth
8 months agoLeonida
8 months agoLashawn
9 months agoLeoma
9 months agoLashanda
9 months agoWhitley
9 months agoAmina
10 months agoTamie
10 months agoNorah
10 months agoCassi
10 months agoSharika
10 months agoRodrigo
11 months agoEllsworth
11 months ago