Universal Containers (UC)uses Apache Kafka on Heroku to stream shipment inventory data in real time throughout the world. A Kafka topic is used to send messages with updates on the shipping container GPS coordinates as they are in transit. UC is using a Heroku Kafka basic-0 plan.The topic was provisioned with 8 partitions, 1 week of retention, and no compaction. The keys for the events are being assigned by Heroku Kafka, which means that they will be randomly distributed between the partitions.
UC has a single-dyno consumer application that persists the data to their Enterprise Data Warehouse (EDW). Recently, they've been noticing data loss in the EDW.
What should an Architect with Kafka experience recommend?
Alton
8 months agoVi
8 months agoJustine
8 months agoDeandrea
9 months agoLeslee
9 months agoChantell
9 months agoCecily
9 months agoSon
9 months agoEleni
10 months agoChristiane
10 months agoRashida
10 months agoKirk
10 months agoSang
1 year agoOra
1 year agoLore
1 year agoRossana
1 year agoJunita
1 year agoBarabara
1 year agoNan
1 year agoZoila
1 year agoStefanie
1 year agoArgelia
1 year agoHoward
1 year agoKenneth
1 year agoLeonida
1 year agoLashawn
1 year agoLeoma
1 year agoLashanda
1 year agoWhitley
1 year agoAmina
1 year agoTamie
1 year agoNorah
1 year agoCassi
1 year agoSharika
1 year agoRodrigo
1 year agoEllsworth
1 year ago