Universal Containers (UC)uses Apache Kafka on Heroku to stream shipment inventory data in real time throughout the world. A Kafka topic is used to send messages with updates on the shipping container GPS coordinates as they are in transit. UC is using a Heroku Kafka basic-0 plan.The topic was provisioned with 8 partitions, 1 week of retention, and no compaction. The keys for the events are being assigned by Heroku Kafka, which means that they will be randomly distributed between the partitions.
UC has a single-dyno consumer application that persists the data to their Enterprise Data Warehouse (EDW). Recently, they've been noticing data loss in the EDW.
What should an Architect with Kafka experience recommend?
Alton
6 months agoVi
7 months agoJustine
7 months agoDeandrea
7 months agoLeslee
7 months agoChantell
8 months agoCecily
8 months agoSon
8 months agoEleni
8 months agoChristiane
8 months agoRashida
8 months agoKirk
8 months agoSang
1 year agoOra
11 months agoLore
12 months agoRossana
12 months agoJunita
12 months agoBarabara
1 year agoNan
1 year agoZoila
1 year agoStefanie
12 months agoArgelia
12 months agoHoward
1 year agoKenneth
12 months agoLeonida
12 months agoLashawn
12 months agoLeoma
12 months agoLashanda
1 year agoWhitley
1 year agoAmina
1 year agoTamie
1 year agoNorah
1 year agoCassi
1 year agoSharika
1 year agoRodrigo
1 year agoEllsworth
1 year ago