BeaConvey: Co-Design of Overlay and Routing for Topic-based Publish/Subscribe on Small-World Networks

  title={BeaConvey: Co-Design of Overlay and Routing for Topic-based Publish/Subscribe on Small-World Networks},
  author={Chen Chen and Yoav Tock and Sarunas Girdzijauskas},
  journal={Proceedings of the 12th ACM International Conference on Distributed and Event-based Systems},
Distributed pub/sub must make principal design choices with regards to overlay topologies and routing protocols. It is challenging to tackle both aspects together, and most existing work merely considers one. We argue the necessity to address both problems simultaneously since only the right combination of the two can deliver an efficient internet-scale pub/sub. Traditional design space spans from structured data-oblivious overlays employing greedy routing strategies all the way to unstructured… 

Figures and Tables from this paper

A communication-efficient causal broadcast publish/subscribe system. (Un système de publication/abonnement efficace et respectant l'ordre causale)
This thesis investigates how to provide a communication-efficient Pub/Sub system, that respects causal order of delivered messages within the same topic and copes with problems of traffic overhead and message contention that exist in several tree-based solutions.
Multistage Adaptive Load Balancing for Big Active Data Publish Subscribe Systems
This paper develops a prototype implementation of a staged approach for broker load balancing that executes in multiple stages --- initial placement of brokers to subscribers, dynamic subscriber migration during operation to handle transient and instantaneous loads and occasional shuffles to re-stabilize the system.
BDS+: An Inter-Datacenter Data Replication System With Dynamic Bandwidth Separation
BDS+ is an application-level multicast overlay network with a fully centralized architecture, allowing a central controller to maintain an up-to-date global view of data delivery status of intermediate servers, in order to fully utilize the available overlay paths.
VCube-PS: A causal broadcast topic-based publish/subscribe system
Building a Framework for High-performance In-memory Message-Oriented Middleware
A framework called RocketBufs is introduced, which provides abstractions and interfaces for constructing high-performance MOM systems, and is used to build a live streaming video application by integrating Rocket Bufs into a web server to receive disseminated video data.
Assessment of Multimodal Rainfall Classification Systems Based on an Audio/Video Dataset
This paper proposes a novel rainfall classification approach based on a video pattern recognition system that uses CNN neural networks and is the first open dataset from the new generation acoustic/video rain gauges available for evaluating the estimated rainfall performance.


Design of Routing Protocols and Overlay Topologies for Topic-based Publish/Subscribe on Small-World Networks
This work designs a practical pub/sub system in peer-to-peer settings, including both routing protocols and overlay topologies, and proposes the Nearest Subscribers and Matched Fingers (NSMF) routing protocol, based on small-world overlays.
Vitis: A Gossip-based Hybrid Overlay for Internet-scale Publish/Subscribe Enabling Rendezvous Routing in Unstructured Overlay Networks
This paper introduces Vitis, a gossip-based publish/subscribe system that significantly decreases the number of relay messages, and scales to an unbounded number of nodes and topics, by enabling rendezvous routing on unstructured overlays.
Constructing scalable overlays for pub-sub with many topics
A new optimization problem, called Minimum Topic-Connected Overlay (Min-TCO), that captures the tradeoff between the scalability of the overlay (in terms of the nodes' fanout) and the message forwarding overhead incurred by the communicating parties is introduced.
OMen: overlay mending for topic-based publish/subscribe systems under churn
OMen supports churn-resistant construction of topic-connected overlays (TCO), which organizes all nodes interested in the same topic in a directly connected dissemination sub-overlay, aiming at pub/sub deployments in data centers.
SpiderCast: a scalable interest-aware overlay for topic-based pub/sub communication
SpiderCast is designed to effectively tread the balance between average overlay degree and communication cost of event dissemination, and it is shown experimentally that, for many practical work-loads, the SpiderCast overlays are both topic-connected and have a low per-topic diameter while requiring each node to maintain a low average number of connections.
TERA: topic-based event routing for peer-to-peer architectures
This paper proposes an architecture for implementing the topic-based publish/subscribe paradigm in large scale peer-to-peer systems based on clustering peers subscribed to the same topic and shows it to be scalable along several fundamental dimensions like number of participants, subscriptions, and to exhibit a fair load distribution.
Efficient content-based routing with network topology inference
A novel approach that exploits the knowledge of event traffic, user subscriptions and topology of the underlying physical network to perform efficient routing in a publish/subscribe system and yields a significant reduction in routing cost in comparison to the state of the art.
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Experimental results obtained with a prototype implementation on an emulated network of up to 100,000 nodes confirm Pastry's scalability and efficiency, its ability to self-organize and adapt to node failures, and its good network locality properties.
Efficient Publish/Subscribe Through a Self-Organizing Broker Overlay and its Application to SIENA
This paper proposes a complementary approach that obtains efficient event dissemination by reorganizing the overlay network topology through a self-organizing algorithm executed by brokers whose aim is to directly connect, through overlay links, pairs of brokers matching same events.