Argonne National Laboratory

Experimental Physics and
Industrial Control System

1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017 Index 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017
<== Date ==> <== Thread ==>

Subject: areaDetector to Apache Kafka plugin and Apache Kafka to areaDetector driver
From: Jonas Nilsson <Jonas.Nilsson@esss.se>
To: "tech-talk@aps.anl.gov" <tech-talk@aps.anl.gov>
Date: Tue, 18 Apr 2017 08:25:13 +0000
As one possible alternative for handling the imaging data which is going to be produced at some of the beam lines of the European Spallation Source, we have developed an areaDetector to Apache Kafka plugin. The plugin guarantees (within reasonable limitations) that data produced by an areaDetector driver is delivered to an Apache Kafka data broker. The data can then be retrieved from the data broker for as long as it is cached. An areaDetector driver which retrieves data from an Apache Kafka broker and makes it available to the IOC has also been developed. 

The code for both these modules is available in the following repository: https://github.com/ess-dmsc/ad-kafka-interface

The documentation of the modules should get most people somewhat familiar with EPICS up and running relatively quickly. Most, if not all, of the functions and classes used in the modules are documented which should make it relatively easy for a developer to get an understanding of how the plugin and driver are implemented. Unit tests exists for large parts of the code though coverage can (and probably should) be improved. Some performance and integration tests have been done but the methods used for doing these can also be improved.

If you are interested in the project, feel free to suggest improvements. The project will likely see some features and other improvements being implemented in the coming months regardless.

Regards,
Jonas

Navigate by Date:
Prev: Re: Archiver Appliance established multiple CA connections for one channel Shankar, Murali
Next: Re: 3.16.1: asynSetTraceMask and asynSetTraceIOMask Pierrick Hanlet
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017
Navigate by Thread:
Prev: EPICS support for Solaris (on SPARC or x86)? Andrew Johnson
Next: runtime problem Pierrick Hanlet
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017
ANJ, 19 Apr 2017 Valid HTML 4.01! · Home · News · About · Base · Modules · Extensions · Distributions · Download ·
· EPICS V4 · IRMIS · Talk · Bugs · Documents · Links · Licensing ·