Version 19.3 by sndueste on 2025/02/05 17:01
Show last authors
1
2
3 {{info title="Typical way to get to DAQ data: HDF5 files"}}
4 **Generally we provide the DAQ data as easy to access HDF5 files. For  more info goto  [[HDF5 file docu>>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]]. and [[DEMO - Working with FLASH data>>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]**
5
6 To get direct access to the saved .raw files there are several (sometimes not anymore supported) ways for experts:
7 {{/info}}
8
9
10 == Manuals Overview for experts ==
11
12
13
14 {{toc/}}
15
16 === DAQ Data Access Related Graphical User Interfaces ===
17
18 ==== How to Use the FLASH DAQ Data GUI? ====
19
20
21 The DAQ Data GUI is a general tool to select and visualise DAQ data. It also contains a DAQ File Manager. The File Manager is used to explore files stored on disk or tape and to retrieve data files from the tape archive too. The DAQ Data GUI can display data retrieved remotely from DOOCS servers. It also can access data stored locally in ROOT formatted .raw files, or files stored locally in HDF5 format.
22
23 Start the DAQdataGUI via Java Webstart.
24
25 **Use the DAQ data GUI locally for staged files:** login at flashlxuser1 (others may not work). One should just put in the run numbrt and define the directory ( with the field in the upper right) and then press get files. (No hooks for local mode or dates or something else ...!!)
26
27
28 ==== ====
29
30 ==== How to Discover Channels Recorded by the DAQ? ====
31
32 You can discover the channels recorded by the DAQ using the DAQdataGUI or the DAQexperiemntGUI, if you have access to the DESY network.
33
34 If you also have access to the .raw files directly, you can use the library {{code language="none"}}jdaq-use{{/code}} to create a searcheable text document. The library includes a command line application producing a list of channels discovered in a given .raw file or at a given point in time. Download this jdaq-use jar. On a computer with access to the MCS-4 NFS filesystem the following command creates the list of channels as follows:
35
36
37 (% class="code" %)
38 (((
39 java -ea -jar jdaq-use-0.0.4-j1.7.jar FLASH1_EXP /daq_data/fel/EXP2 FLASH1_EXP_stream_2_run17666_file1_20170610T065636.1.raw
40 )))
41
42 In case you get no access, you could also use the [[DAQ Channel Info Database>>url:http://aps.anl.gov/~~nda/ilc/daq_startPage.php||shape="rect"]] as explained on the [[help pages>>url:http://aps.anl.gov/~~nda/ilc/daq_help.htm||shape="rect"]] by Ned Arnold of the [[Argonne Advanced Photon Source>>url:http://www.aps.anl.gov/||shape="rect"]].
43
44
45
46 === DAQ Run Control Graphical User Interfaces ===
47
48
49 ==== How to Start the DAQ Status GUI? ====
50
51 The DAQ Status GUI displays the current DAQ data flow from frontend through collectors, event builder to the dCache. The GUI can be started via Java Webstart for the [[Photon Beam DAQ>>url:http://ttfinfo2.desy.de/common/applications/jddd_xml/svn_jnlp.jsp?run=true&file=/svn/FLASH/DAQ/daq_status_pbd.xml||shape="rect"]] and the [[secondary experiment DAQ>>url:http://ttfinfo2.desy.de/common/applications/jddd_xml/svn_jnlp.jsp?run=true&file=/svn/FLASH/DAQ/daq_status_exp2.xml||shape="rect"]], respectively.
52
53
54 ==== How to Start the Run Control GUI? ====
55
56 The Run Control GUI is used to configure the DAQ run controller reflected in the run control data base. The Run Control GUI can be run on the central DOOCS user machines only. To start the GUI login with X-forwarding enabled to e.g. "flashlxuser1" and execute the command "RCGUIPBD" for the photon beam DAQ run control or the command "RCGUIEXP2" for the secondary experiment DAQ.
57
58
59 ==== How to Monitor the Experiment DAQ? ====
60
61 [[How to Monitor the Experiment DAQ?>>url:https://ttfinfo.desy.de/FLASHWiki/Wiki.jsp?page=How%20to%20monitor%20the%20Experiment%20DAQ||shape="rect"]] (DOOCS Wiki, NN, 2011)
62
63 This page explains, how to check, if the DAQ is running, i.e. if the DAQ is collecting and writing data. Possibly the page is not quite up to date ~-~- the uninitiated user is hardly able to follow the instructions given.
64
65
66 === General Introductions to the FLASH DAQ ===
67
68
69 * [[Access to FLASH DAQ Data>>url:http://fla.desy.de/localfsExplorer_read?currentPath=/afs/desy.de/group/fla/www/publications/2011/Rybnikov_FELseminar2011.pdf||shape="rect"]] (Rybnikov 2011)
70
71 * Data Acquisition System (Agababyan et al. in [[ICFA Beam Dynamics Newsletter, 47>>url:http://www-bd.fnal.gov/icfabd/Newsletter47.pdf||shape="rect"]] , pages 149-154, 2008)
72
73 * [[FLASH DAQ Data Management and Access Tools>>url:http://tesla.desy.de/doocs/doocs_papers/PCaPAC2010/frcoma02.pdf||shape="rect"]] (Rybnikov et al., 2013)
74
75 * More general literature on DOOCS and the DAQ is listed on the [[DOOCS Publications>>url:http://tesla.desy.de/doocs/doocs_papers/papers.html||shape="rect"]] page.
76
77 === Other Resources for DAQ and dCache ===
78
79 N.B. The general DESY info on its dCache do not directly apply to the FLASH DAQ dCache.
80
81
82 * [[The dCache Book>>url:http://www.dcache.org/manuals/||shape="rect"]]
83
84 * [[The Mass Storage Service (dCache/OSM)>>url:https://it.desy.de/e5/e47139/e193654/index_ger.html?preview=preview||shape="rect"]]
85
86 == Contact Info ==
87
88 for Questions / Problems:
89
90 * DAQ: [[Vladimir_Rybnikov>>url:mailto://vladimir.rybnikov@desy.de||shape="rect"]] FLA Tel : 4846
91
92