Universal Containers (UC)uses Apache Kafka on Heroku to stream shipment inventory data in real time throughout the world. A Kafka topic is used to send messages with updates on the shipping container GPS coordinates as they are in transit. UC is using a Heroku Kafka basic-0 plan.The topic was provisioned with 8 partitions, 1 week of retention, and no compaction. The keys for the events are being assigned by Heroku Kafka, which means that they will be randomly distributed between the partitions.
UC has a single-dyno consumer application that persists the data to their Enterprise Data Warehouse (EDW). Recently, they've been noticing data loss in the EDW.
What should an Architect with Kafka experience recommend?
Sang
2 months agoLore
2 days agoRossana
4 days agoJunita
6 days agoBarabara
19 days agoNan
1 months agoZoila
2 months agoStefanie
10 days agoArgelia
13 days agoHoward
2 months agoKenneth
6 days agoLeonida
11 days agoLashawn
13 days agoLeoma
14 days agoLashanda
22 days agoWhitley
1 months agoAmina
2 months agoTamie
2 months agoNorah
2 months agoCassi
2 months agoSharika
2 months agoRodrigo
2 months agoEllsworth
3 months ago