Last modified by sndueste on 2025/02/05 17:02
From version 18.2
edited by sndueste
on 2025/02/05 11:21
Change comment: Update document after refactoring.
To version 19.3
edited by sndueste
on 2025/02/05 17:01
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,7 +1,7 @@
1 1  
2 2  
3 3  {{info title="Typical way to get to DAQ data: HDF5 files"}}
4 -**Generally we provide the DAQ data as easy to access HDF5 files. For  more info goto  [[HDF5 file docu>>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]]. and [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]**
4 +**Generally we provide the DAQ data as easy to access HDF5 files. For  more info goto  [[HDF5 file docu>>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]]. and [[DEMO - Working with FLASH data>>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]**
5 5  
6 6  To get direct access to the saved .raw files there are several (sometimes not anymore supported) ways for experts:
7 7  {{/info}}
... ... @@ -17,34 +17,21 @@
17 17  
18 18  ==== How to Use the FLASH DAQ Data GUI? ====
19 19  
20 -[[How to Use the FLASH DAQ Data GUI?>>url:https://ttfinfo.desy.de/FLASHWiki/Wiki.jsp?page=FLASHDAQdataGUI||shape="rect"]] (DOOCS Wiki, Rybnikov, 2013)
21 21  
22 22  The DAQ Data GUI is a general tool to select and visualise DAQ data. It also contains a DAQ File Manager. The File Manager is used to explore files stored on disk or tape and to retrieve data files from the tape archive too. The DAQ Data GUI can display data retrieved remotely from DOOCS servers. It also can access data stored locally in ROOT formatted .raw files, or files stored locally in HDF5 format.
23 23  
24 -Start the [[DAQdataGUI>>url:http://ttfinfo2.desy.de/common/applications/DAQdataGUI-experimental.jnlp||shape="rect"]] via Java Webstart.
23 +Start the DAQdataGUI via Java Webstart.
25 25  
26 26  **Use the DAQ data GUI locally for staged files:** login at flashlxuser1 (others may not work). One should just put in the run numbrt and define the directory ( with the field in the upper right) and then press get files. (No hooks for local mode or dates or something else ...!!)
27 27  
28 28  
29 -==== How to Use the DAQ Converter GUI? ====
28 +==== ====
30 30  
31 -The DAQ Converter GUI is used to convert DAQ data stored in the ROOT format, a self describing hierarchical binary format optimised for fast access, into ASCII formatted data for offline analysis. The GUI allows to select the files and channels from files to be converted. The GUI also has an interface to plug-in converters to write other data formats (Rybnikov et al., 2010).
32 -
33 -Start the [[DAQexperiemntGUI>>url:http://ttfinfo2.desy.de/common/applications/DAQexperimentGUI.jnlp||shape="rect"]] via Java Webstart.
34 -
35 -
36 -==== How to Stage Data From DAQ? ====
37 -
38 -[[How to Stage Data From DAQ?>>url:https://ttfinfo.desy.de/FLASHWiki/attach/FLASHDAQfileMANAGER/How%20to%20stage%20data%20from%20DAQ.pdf||shape="rect"]] (Brenner, 2013)
39 -
40 -This manual explains step by step how to use the DAQ File Manager GUI started via the [[DAQdataGUI>>url:http://ttfinfo2.desy.de/common/applications/DAQdataGUI-experimental.jnlp||shape="rect"]] to copy DAQ data files from tape to disk for offline analysis, if one does not want to use one of the APIs listed below.
41 -
42 -
43 43  ==== How to Discover Channels Recorded by the DAQ? ====
44 44  
45 -You can discover the channels recorded by the DAQ using the [[DAQdataGUI>>url:http://ttfinfo2.desy.de/common/applications/DAQdataGUI-experimental.jnlp||shape="rect"]] or the [[DAQexperiemntGUI>>url:http://ttfinfo2.desy.de/common/applications/DAQexperimentGUI.jnlp||shape="rect"]], if you have access to the DESY network.
32 +You can discover the channels recorded by the DAQ using the DAQdataGUI or the DAQexperiemntGUI, if you have access to the DESY network.
46 46  
47 -If you also have access to the .raw files directly, you can use the library {{code language="none"}}jdaq-use{{/code}} to create a searcheable text document. The library includes a command line application producing a list of channels discovered in a given .raw file or at a given point in time. Download this [[jdaq-use jar>>url:http://hasfweb.desy.de/pub/Setup/DAQRootGui/jdaq-use-0.0.4-j1.7.jar||shape="rect"]]. On a computer with access to the MCS-4 NFS filesystem the following command creates the list of channels as follows:
34 +If you also have access to the .raw files directly, you can use the library {{code language="none"}}jdaq-use{{/code}} to create a searcheable text document. The library includes a command line application producing a list of channels discovered in a given .raw file or at a given point in time. Download this jdaq-use jar. On a computer with access to the MCS-4 NFS filesystem the following command creates the list of channels as follows:
48 48  
49 49  
50 50  (% class="code" %)
... ... @@ -54,27 +54,8 @@
54 54  
55 55  In case you get no access, you could also use the [[DAQ Channel Info Database>>url:http://aps.anl.gov/~~nda/ilc/daq_startPage.php||shape="rect"]] as explained on the [[help pages>>url:http://aps.anl.gov/~~nda/ilc/daq_help.htm||shape="rect"]] by Ned Arnold of the [[Argonne Advanced Photon Source>>url:http://www.aps.anl.gov/||shape="rect"]].
56 56  
57 -TODO: Explain how to use "rpc_test" to discover DAQ data and channels.
58 58  
59 59  
60 -=== Application Program Interfaces to Access DAQ Data ===
61 -
62 -
63 -* C++: [[Instructions how to use the TTF2 data processing framework>>url:https://ttfinfo.desy.de/DOOCSWiki/Wiki.jsp?page=CDAQInterface||shape="rect"]] .
64 -The C++ library sources are available from the DOOCS [[CVS repository>>url:http://doocs.desy.de/cgi-bin/viewvc.cgi/source/daq/DAQUser/||shape="rect"]] .
65 -
66 -* Java
67 -
68 -* Matlab:
69 -** [[How to Access the DAQ Using Matlab >>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).For experts\: many ways to get Data from the DAQ.How to Access the DAQ Using Matlab.WebHome]] (no longer recommended)
70 -** [[MATLAB Interface to DAQ Data>>url:https://ttfinfo.desy.de/DOOCSWiki/Wiki.jsp#section-MATLABClientInterface-MATLABInterfaceToDAQData?page=MATLABClientInterface||shape="rect"]], the MCS-4 Wiki page
71 -
72 -* Octave: [[DAQ to Octave Library for FLASH data analysis>>attach:Martins2009.pdf]]
73 -
74 -* Python: [[PythonDAQClientInterface>>url:https://ttfinfo.desy.de/DOOCSWiki/Wiki.jsp?page=PythonDAQClientInterface||shape="rect"]]
75 -
76 -* [[DAQ Access From Jddd>>url:https://ttfinfo.desy.de/FLASHWiki/attach/How%20to%20use%20JDDD%20for%20accessing%20DAQ%20data/DaqInJddd.doc.pdf||shape="rect"]] (Rehlich, 2010)
77 -
78 78  === DAQ Run Control Graphical User Interfaces ===
79 79  
80 80