Fast Data apps with Alpakka Kafka connector and Akka Streams

The Alpakka Kafka connector (formerly known as reactive-kafka) is a component of the Alpakka project.  It provides a diverse streaming toolkit, but sometimes it can be challenge to design these systems without a lot of experience with Akka Streams and Akka.  By combining Akka Streams with Kafka using Alpakka Kafka, we can build rich domain, low latency, and stateful streaming applications with very little infrastructure.

This talk will discuss solutions to common Kafka and streaming problems such as consumer group partition rebalancing, stateful stages, state durability/persistence, as well as a deep-dive into effectively-once/transactional message delivery with Kafka.

The Alpakka project is an open source initiative to implement stream-aware, reactive, integration pipelines for Java and Scala. It is built on top of Akka Streams, and has been designed from the ground up to understand streaming natively and provide a DSL for reactive and stream-oriented programming, with built-in support for backpressure.