Universal Containers (UC)uses Apache Kafka on Heroku to stream shipment inventory data in real time throughout the world. A Kafka topic is used to send messages with updates on the shipping container GPS coordinates as they are in transit. UC is using a Heroku Kafka basic-0 plan.The topic was provisioned with 8 partitions, 1 week of retention, and no compaction. The keys for the events are being assigned by Heroku Kafka, which means that they will be randomly distributed between the partitions.
UC has a single-dyno consumer application that persists the data to their Enterprise Data Warehouse (EDW). Recently, they've been noticing data loss in the EDW.
What should an Architect with Kafka experience recommend?
Alton
5 months agoVi
5 months agoJustine
5 months agoDeandrea
6 months agoLeslee
6 months agoChantell
6 months agoCecily
6 months agoSon
6 months agoEleni
7 months agoChristiane
7 months agoRashida
7 months agoKirk
7 months agoSang
11 months agoOra
10 months agoLore
10 months agoRossana
10 months agoJunita
10 months agoBarabara
11 months agoNan
11 months agoZoila
12 months agoStefanie
10 months agoArgelia
10 months agoHoward
12 months agoKenneth
10 months agoLeonida
10 months agoLashawn
10 months agoLeoma
10 months agoLashanda
11 months agoWhitley
11 months agoAmina
1 year agoTamie
1 year agoNorah
1 year agoCassi
1 year agoSharika
1 year agoRodrigo
1 year agoEllsworth
1 year ago