If you are using Spark Streaming Kafka Direct API and you are storing offsets in Zookeeper, you might want to reuse offsets from Zookeeper and not always rely on checkpoint. KafkaUtils.createDirectStream() has a fromOffsets parameter which you can provide
Discover 3 stories with “Monitoring” Tag.
If you are using Spark Streaming's new Kafka Direct API you might be missing some things, like monitoring tools that only work with offsets in ZK. For example, Kafka's kafka-consumer-offset-checker.sh which is very helpful to check consumer lag, meaning
Play! Jobs - Web UI for Play! Framework Async Jobs and Monitoring API with RESTEasy, JAX-RS, REST and JSON
on api, Async Jobs, Hyperic, Jobs, JSON, Monitoring, Nagios, Play! Framework, Play! Jobs, REST, RESTEasy, RESTful
My latest open source contribution is Play! Jobs, hosted on the always awesome Github. Play! Jobs is a Web Interface to manage and trigger async jobs running on a Play! Framework application. It also provides a JAX-RS/RESTFul API, exposed