Author: Kourousias, G.
Paper Title Page
WEPHA057 Building a Data Analysis as a Service Portal 1228
  • A. Götz, A. Campbell
    ESRF, Grenoble, France
  • I. Andrian, G. Kourousias
    Elettra-Sincrotrone Trieste S.C.p.A., Basovizza, Italy
  • A. Camps, D. Salvat, D. Sanchez
    ALBA-CELLS Synchrotron, Cerdanyola del Vallès, Spain
  • M. van Daalen
    PSI, Villigen PSI, Switzerland
  Funding: This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 730872
As more and more scientific data are stored at photon sources there is a growing need to provide services to access to view, reduce and analyze the data remotely. The Calipsoplus* project, in which all photon sources in Europe are involved in, has recognized this need and created a prototype portal for Data Analysis as a Service. This paper will present the technology choices, the architecture of the blueprint, the prototype services and the objectives of the production version planned in the medium term. The paper will cover the challenges of building a portal from scratch which covers the needs of multiple sites, each with their own data catalogue, local computing infrastructure and different workflows. User authentication and management are essential to creating a useful but sustainable service.
DOI • reference for this paper ※  
About • paper received ※ 01 October 2019       paper accepted ※ 09 October 2019       issue date ※ 30 August 2020  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)  
THBPP02 DonkiOrchestra: A Software Trigger-Driven Framework for Data Collection and Experiment Management Based on Zeromq Distributed Messaging 1575
  • R. Borghes, F. Billè, V. Chenda, G. Kourousias, M. Prica
    Elettra-Sincrotrone Trieste S.C.p.A., Basovizza, Italy
  Synchrotron end-stations consist of a complex network of devices. The setup is not static and is often upgraded. The data acquisition systems are constantly challenged by such changes and upgrades, so scalability and flexibility are crucial skills. DonkiOrchestra is a ZeroMQ-based framework for data acquisition and experiment control based on an advanced software trigger-driven paradigm. In the DonkiOrchestra approach a software device, referred to as Director, provides the logical organization of the experiment as a sequential workflow relying on triggers. Each software trigger activates a set of Actor devices that can be hierarchically organized according to different priority levels. Data acquired by the Actors is tagged with the trigger number and stored in HDF5 archives. The intrinsic asynchronicity of ZeroMQ maximizes the opportunity of performing parallel operations and sensor readouts. This paper describes the software architecture behind DonkiOrchestra, which is fully configurable and scalable, so it can be reused on multiple endstations and facilities. Furthermore, experimental applications at Elettra beamlines and future developments are presented and discussed.  
slides icon Slides THBPP02 [1.360 MB]  
DOI • reference for this paper ※  
About • paper received ※ 30 September 2019       paper accepted ※ 10 October 2019       issue date ※ 30 August 2020  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)