java-分布式系统中的消息传递和信令
作者:互联网
我有一个分布式视频分析系统,该系统包括:
1. feature extraction: generated lots of features(20+) from each frame of the video
2. multiple detectors(in different machine):
* Each of them will get a subset of feature
* Each of them needs the features from multiple frames.
* Eg. Detector 1 needs feature 1-5 from 3 frames to start processing; Detector 2 needs feature 2-8 from 8 frames to start processing
我的问题是:如何进行特征提取模块和多个检测器之间的通信,最好是实时进行?我一直在研究事件总线,但这仅是一个过程,Hadoop中的ZooKeeper会是更好的解决方案吗?
我正在使用Java.任何建议都欢迎.
解决方法:
在Java中,您可以考虑使用RabbitMQ消息总线.有一个带Java bindings的图书馆.
RabbitMQ is based on a proven
platform, offering exceptionally high
reliability, availability and
scalability along with good throughput
and latency performance that is
predictable and consistent. It has a
compact, easily maintainable code base
allowing rapid customisation and hot
deployment. There are extensive
facilities for management, monitoring,
control and debugging and it is
supported by a full range of
commercial support services and an
active community developing packages
that extend the core system.
标签:video,apache-zookeeper,message,distributed,java 来源: https://codeday.me/bug/20191210/2100974.html