RT-ZooKeeper: Taming the Recovery Latency of a Coordination Service

Fault-tolerant coordination services have been widely used in distributed applications in cloud environments. Recent years have witnessed the emergence of time-sensitive applications deployed in edge computing environments, which introduces both challenges and opportunities for coordination services. On one hand, coordination services must recover from failures in a timely manner. On the other hand, edge computing employs local networked platforms that can be exploited to achieve timely recovery. In this work, we first identify the limitations of the leader election and recovery protocols underlying Apache ZooKeeper, the prevailing open-source coordination service. To reduce recovery latency from leader failures, we then design RT-Zookeeper with a set of novel features including a fast-convergence election protocol, a quorum channel notification mechanism, and a distributed epoch persistence protocol. We have implemented RT-Zookeeper based on ZooKeeper version 3.5.8. Empirical evaluation shows that RT-ZooKeeper achieves 91% reduction in maximum recovery latency in comparison to ZooKeeper. Furthermore, a case study demonstrates that fast failure recovery in RT-ZooKeeper can benefit a common messaging service like Kafka in terms of message latency.

Personality composition determines social learning pathways within shoaling fish

In shaping how individuals explore their environment and interact with others, personality may mediate both individual and social learning. Yet increasing evidence indicates that personality expression is contingent on social context, suggesting that group personality composition may be key in determining how individuals learn about their environment. Here, we used recovery latency following simulated predator attacks to identify Trinidadian guppies ( Poecilia reticulata ) that acted in a consistently bold or shy manner. We then employed network-based diffusion analysis to track the spread of a novel foraging behaviour through groups containing different proportions of bold and shy fish. Informed associates promoted learning to a greater extent in bold individuals, but only within groups composed predominately of bold fish. As the proportion of shy fish within groups increased, bold individuals instead emerged as especially effective demonstrators that facilitated learning in others. Individuals were also more likely to learn overall within shy-dominated groups than in bold-dominated ones. We demonstrate that whether and how individuals learn is conditional on group personality composition, indicating that selection may favour traits enabling individuals to better match their behavioural phenotype to their social environment.