Releases: mesos/kafka
Releases · mesos/kafka
v0.10.0.0
This release brings a many major new features an enhancements.
- The scheduler now builds against 0.8.2.2, 0.9+, and 0.10+. It is HIGHLY recommended to use a version of the scheduler built against the same version of kafka that will be launched. This is due to changes over time to the kafka zookeeper layout/APIs.
- Rolling restarts now wait for replication to catch up after restarting each broker. This can be disabled with the
--noWaitForReplication
flag tobroker restart
. - The mesos offer management system has been significantly refactored. On versions of mesos that support it (
0.25.0+
), offers to the framework will be completed suppressed when the cluster is in a "steady state". Additionally, offers that don't match a broker are rejected with a long filter duration. On clusters with large amounts of offers this should significantly decrease the CPU usage on both the mesos master and kafka-mesos scheduler. - Reconciliation has been improved, and the default timeout significantly increased to protect against accidentally terminating brokers on a mesos master failover.
- A new CLI command has been added (as well as REST endpoint) to get all metrics published by a set of brokers:
broker metrics
Breaking changes
While we try very hard to preserve backwards compatibility between releases, there are times that breaking changes must be made. This release introduces one, which may impact people who have built tooling around the HTTP API.
- Methods that mutate state (broker restart, add, delete, etc) no longer accept GET requests, only POST. This is to lock down the scheduler to prevent unintended actions (eg via malicious URLs).
Note: The attached artifacts are built with JDK 1.8 for Kafka 0.9.0.1 and 0.10.1.1.
v0.9.5.1 Release
- change task and executor name to the framework name
- test case fixes, refactoring
0.9.5.0 Release
- rolling restart via scheduler api / cli https://github.com/mesos/kafka#rolling-restart
- broker metrics via scheduler api / cli https://github.com/mesos/kafka#broker-metrics
- broker logs via scheduler api / cli https://github.com/mesos/kafka#view-broker-log
- minimesos support https://github.com/mesos/kafka/blob/master/quickstart.sh
0.9.4.0 Release
0.9.3.0 Release
broker add|update
command now supports--volume
option, specifying pre-reserved persistent volume id
0.9.2.0 Release
- topic list, add update admin features through scheduler
- assignment of partition based on attribute, provides rack awareness for partitions
- refactored CLI & REST API to support broker and topic sub commands
- breaking change in the API remove plural (e.g. api/brokers are now api/broker)
0.9.1.4 Release
Fixes for stats metrics not starting and being reported properly.
0.9.1.3 Release
- build number for jar didn't match tag
0.9.1.2 release
- fixes for multiple schedulers' state
- scheduler bind address update
0.9.1.1 release
- Changed default failover for broker from delay of 1 minute and max-delay of 10 minutes. This failover is related to the broker failing and being relaunched on the same slave node. At some point this should give up. Future version will accept a callback from an outside plug-in for monitoring issues such as disk space. Often other schedulers might be part of the general allocation so a time window of trying for 1 minute with a progression to not exceed 10 minutes (based on maxTries which is still defaulted to 2). #77 created to add more scheduler ability to deal with infrastructure acked problems programmatically and more metrics.
- Broker Placement Stickiness - For both failover and manual restarts you often want a window of time that the scheduler will wait for the same resources it had before to become available. When this exceeds the time set the scheduler will then seek resources from another machine. A manual stop can be issued before or during the time period for maintenance tasks via the CLI or REST API.