Skip to Content
Last modified by sndueste on 2025-09-08 15:36
From version 9.1
edited by sndueste
on 2019-09-18 16:46
Change comment: There is no comment for this version
To version 7.1
edited by sendels
on 2019-05-15 13:07
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.sndueste
1 +XWiki.sendels
Content
... ... @@ -1,7 +1,26 @@
1 +\\
1 1  
3 +* General Concept
4 +* Taking User data: Starting and stopping runs (Users)
5 +** DAQ control panel
6 +** Checklist for proper saving of the data
7 +** More infos on the tools to check the proper saving of the data
8 +** How to get the data out for analysis (short summary)
9 +* Setting up the DAQ - DAQ Run Control GUI (local contacts, FLASH stuff)
10 +** Configuring the DAQ
11 +** Configuring the DAQ monitor
12 +** Start and Stop a run
13 +** Load/Save the configuration
14 +** Assigning the DAQ to the beamline in jddd
15 +** Setting the logbook to print in / putting the Whitelist name in jddd
16 +* In case something goes wrong: Troubleshooting
17 +** No START or STOP buttons are visible in the DAQ control panel
18 +** The DAQ does not start a run
19 +** Data seems not properly saved
20 +** Restarting the DAQ
21 +** what else ???
22 +** Re-read the data base
2 2  
3 -{{toc/}}
4 -
5 5  \\
6 6  
7 7  == General Concept ==
... ... @@ -21,15 +21,15 @@
21 21  === DAQ control panel ===
22 22  
23 23  To get to the User DAQ control one has to go to {{code language="none"}}Experiment control{{/code}} -> {{code language="none"}}User DAQ tab{{/code}} -> {{code language="none"}}FLxUSERy DAQ CTRL{{/code}}
24 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/jddd_DAQ-control-manual-how_to_get.png~|~|alt="jddd_DAQ-control-manual-how_to_get.png" width="500" height="360"~]~]>>attach:jddd_DAQ-control-manual-how_to_get.png]]
43 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/jddd_DAQ-control-manual-how_to_get.png||alt="jddd_DAQ-control-manual-how_to_get.png" width="500" height="360"]]
25 25  \\The following window opens. Here the User DAQ can be started and stopped as well as the incoming data can be visualized, information about data rates and saved properties is presented as well as the panel is automatically printed in to the logbook:
26 26  
27 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/jddd_DAQ-control-manual2.png~|~|alt="jddd_DAQ-control-manual2.png" width="960" height="720"~]~]>>attach:jddd_DAQ-control-manual2.png]]
46 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/jddd_DAQ-control-manual2.png||alt="jddd_DAQ-control-manual2.png" width="960" height="720"]]
28 28  \\\\
29 29  
30 30  \\
31 31  
32 -* By pressing the start and stop button, besides sending the commands to the DAQ the button prints the panel to the respective beamline / experiments logbook. Here you can later on keep track of the runs. Links to the Beamline logbooks can be found [[here>>doc:FLASH.Electronic Logbooks]] (DESY internal link)
51 +* By pressing the start and stop button, besides sending the commands to the DAQ the button prints the panel to the respective beamline / experiments logbook. Here you can later on keep track of the runs. Links to the Beamline logbooks can be found [[here>>doc:FLASHUSER.Electronic Logbooks]] (DESY internal link)
33 33  * After starting, the stop button appears only after saving abut 200 shots to prevent too early stopping which may disturb the DAQ.
34 34  * Each run has a unique run number. This number is needed to retrieve the data later on. So it is important to keep track which number is associated to what experimental parameters. Note that the run numbers are used by all FLASH DAQs (currently about 10). It might thus well be, that two consecutive runs from you do have run numbers which are spaced by more than one if another DAQ has been started in-between ...
35 35  
... ... @@ -74,10 +74,10 @@
74 74  
75 75  To ultimately check if the correct data is saved one can use the DAQ data GUI to look at the saved raw. files.
76 76  
77 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQgui1.jpg~|~|alt="DAQgui1.jpg" width="500" height="350"~]~]>>attach:DAQgui1.jpg]][[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQgui2.jpg~|~|alt="DAQgui2.jpg" width="500" height="350"~]~]>>attach:DAQgui2.jpg]][[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/daqgui3.png~|~|alt="daqgui3.png" width="500" height="350"~]~]>>attach:daqgui3.png]]
96 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQgui1.jpg||alt="DAQgui1.jpg" width="500" height="350"]][[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQgui2.jpg||alt="DAQgui2.jpg" width="500" height="350"]][[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/daqgui3.png||alt="daqgui3.png" width="500" height="350"]]
78 78  \\
79 79  
80 -The DAQ Data GUI is a general tool to select and visualise data that was saved in the DAQ . It has in addition simple analysis options like histogram, mean, min or max values as function of time etc. Also correlations between different parameters can be analyzed in the tool. More details can be found [[How to Use the FLASH DAQ Data GUI?~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://ttfinfo.desy.de/FLASHWiki/Wiki.jsp?page=FLASHDAQdataGUI||shape="rect"]] and [[ here (DAQdataGUI link collection) >>doc:FLASH.How to get the data out of the DAQ]]
99 +The DAQ Data GUI is a general tool to select and visualise data that was saved in the DAQ . It has in addition simple analysis options like histogram, mean, min or max values as function of time etc. Also correlations between different parameters can be analyzed in the tool. More details can be found [[How to Use the FLASH DAQ Data GUI?~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://ttfinfo.desy.de/FLASHWiki/Wiki.jsp?page=FLASHDAQdataGUI||shape="rect"]] and [[ here (DAQdataGUI link collection) >>doc:FLASHUSER.How to get the data out of the DAQ]]
81 81  
82 82  The tool (separate Java program) can be started [[DAQdataGUI~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://ttfinfo2.desy.de/common/applications/DAQdataGUI-experimental.jnlp||shape="rect"]] or in the DAQ control panel ( lower right) on your local (Desy) PC. In some cases the access via Windows does not work. An option which should always work is to log onto {{code language="none"}}flashlxuser1{{/code}} or {{code language="none"}}flashlxuser2{{/code}} and start {{code language="none"}}DAQdataGUI{{/code}} from the command line.
83 83  
... ... @@ -98,7 +98,7 @@
98 98  
99 99  * The FLASH DAQ system records the data in binary " {{code language="none"}}.raw{{/code}} " files.
100 100  ** [[reading the data via Matlab >>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).For experts\: many ways to get Data from the DAQ.How to Access the DAQ Using Matlab.WebHome]] works not for all data types equally well and needs precise knowledge of the desired Parameters (useful to have a quick look / preliminary analysis on few parameters).
101 -** Examples how to read from {{code language="none"}}.raw{{/code}} files can also be found in [[the user code collection>>doc:FLASH.Collection of user codes]]
120 +** Examples how to read from {{code language="none"}}.raw{{/code}} files can also be found in [[the user code collection>>doc:FLASHUSER.Collection of user codes]]
102 102  ** Note that the raw data is only accessible from certain computers within the DESY network and thus not very handy for offline analysis later on ...
103 103  
104 104  \\
... ... @@ -106,8 +106,8 @@
106 106  * To ease the data analysis we IN ADDITION provide //ON REQUEST// the data from the FLASH DAQ as HDF5 format
107 107  ** ONLINE HDF5s: To make efficient use of the HDF5 files for analysis during the beamtime and afterwards we provide a [[very useful tool (Beamtime Daq Access)>>doc:FLASHUSER.Near-Online data analysis]]. Using this tool (working for Python and Matlab) one can get the data of parameters per run or for specific bunch ID intervals etc. without having to care from which subset of HDF5 files the data is read ...
108 108  ** Summary HDF5 files include complete runs. They will be put after the beamtime on the gpfs storage and are available from computers within DESY (for registered Beamtime participants) and also access
109 -** Intro to the [[HDF5 structure used at FLASH>>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]]. This contains also a list of the most used Parameters saved at FLASH for analysis - including the HDF5 names, DOOCS and DAQ names ...
110 -** [[Short examples>>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]] and [[user provided examples>>doc:FLASH.Collection of user codes]] on how to read HDF5 in Matlab
128 +** Intro to the [[HDF5 structure used at FLASH>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main||shape="rect" class="twikiLink"]]. This contains also a list of the most used Parameters saved at FLASH for analysis - including the HDF5 names, DOOCS and DAQ names ...
129 +** [[Short examples>>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]] and [[user provided examples>>doc:FLASHUSER.Collection of user codes]] on how to read HDF5 in Matlab
111 111  
112 112  The HDF5 files (online and summary) are saved in the [["gpfs" system ~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://confluence.desy.de/display/ASAP3/Architecture||shape="rect"]]. it can be accessed from [[Windows and Linux computers at DESY~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://confluence.desy.de/display/ASAP3/Mounting+the+storage+system+at+the+beamline||shape="rect"]] by the persons ( logins) which are registered for the beamtime in DOOR ( functional accounts
113 113  
... ... @@ -133,7 +133,7 @@
133 133  === Configuring the DAQ ===
134 134  
135 135  
136 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/RCGUI_2.jpg~|~|alt="RCGUI_2.jpg" width="400" height="500"~]~]>>attach:RCGUI_2.jpg]]
155 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/RCGUI_2.jpg||alt="RCGUI_2.jpg" width="400" height="500"]]
137 137  
138 138  Using the jddd DAQ control panel one can start and stop runs but in order to configure the DAQ which data to save one has to use a a separate *DAQ run control * java application. Since it needs write access to DOOCS internal file systems, which can not be made available elsewhere one has to start the system on our DOOCS control computers [[flashlxuser1.desy.de>>url:http://flashlxuser1.desy.de||shape="rect"]]{{code language="none"}}{{/code}} or [[flashlxuser2.desy.de>>url:http://flashlxuser2.desy.de||shape="rect"]]{{code language="none"}}{{/code}}.
139 139  Log in with the beamline account (bl1user, bl2user, ..., fl24user...) either via X-Win32 from windows or via ssh from Linux machines.
... ... @@ -180,7 +180,7 @@
180 180  
181 181  \\
182 182  
183 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/RCGUI_properties.jpg~|~|alt="RCGUI_properties.jpg" width="503" height="311"~]~]>>attach:RCGUI_properties.jpg]]
202 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/RCGUI_properties.jpg||alt="RCGUI_properties.jpg" width="503" height="311"]]
184 184  
185 185  \\
186 186  
... ... @@ -192,7 +192,7 @@
192 192  
193 193  The DAQ monitor ( and the Offline monitor) can be confgured using DAQdataGUI.
194 194  Load a test run containing all relavant propoerties. Select all properties you want to monitor. Use {{code language="none"}}Tools -> Channels to DAQMonitor{{/code}} and choose your DAQ. This sends a list with the selected properties to the DAQ monitor of your system.
195 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/daq_monitor_config.png~|~|alt="daq_monitor_config.png" width="700" height="390"~]~]>>attach:daq_monitor_config.png]]
214 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/daq_monitor_config.png||alt="daq_monitor_config.png" width="700" height="390"]]
196 196  
197 197  \\
198 198  
... ... @@ -200,7 +200,7 @@
200 200  
201 201  === Start and Stop a run ===
202 202  
203 -In order to "activate" and test your configuration you have to start a run with the new configuration. **NOTE: Whenever the configuration was changed with the RCGUI the new run HAS to be started with the RCGUI **(starting with the jddd DAQ panel would only start the last configuration that has been running before !!!
222 +In order to "activate" and test your configuration you have to start a run with the new configuration. **NOTE: Whenever the configuratio was changed with the RCGUI the new run HAS to be started with the RCGUI **(starting with the jddd DAQ panel would only start the last configuration that has been running before !!!
204 204  
205 205  \\
206 206  
... ... @@ -221,7 +221,7 @@
221 221  === Load/Save the configuration ===
222 222  
223 223  
224 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/whitelist.jpg~|~|alt="whitelist.jpg" width="532" height="370"~]~]>>attach:whitelist.jpg]]
243 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/whitelist.jpg||alt="whitelist.jpg" width="532" height="370"]]
225 225  
226 226  Once a list of subsystems is defined and tested this parameter combination should then be saved in a so-called //white list//. By loading this white list one can then easily configure the DAQ after changes / restarts ... to the initially defined settings to save the correct data.
227 227  The whitelist can be saved/loaded with the Run Control GUI by: {{code language="none"}}File -> Group White List -> Save/Load{{/code}}. Note, while the top left rectangle's background of time and date is yellow, don't try any further controls of the GUI, you might confuse the program. It is busy reading the configuration from the run control database. The background changes back to grey when it has finished.
... ... @@ -250,10 +250,10 @@
250 250  
251 251  === Setting the logbook to print in / putting the Whitelist name in jddd ===
252 252  
253 -The jddd DAQ Control should be set up that it prints by default the relevant run information in the logbook associated to your beamline [[Logbooks>>doc:FLASH.Electronic Logbooks]]
272 +The jddd DAQ Control should be set up that it prints by default the relevant run information in the logbook associated to your beamline [[Logbooks>>doc:FLASHUSER.Electronic Logbooks]]
254 254  
255 255  Define logbook / and whitelist for display in the jddd DAQ control (jddd otherwise does not "know" which White list was used ... this has to be put in by hand ...up to now)
256 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/setting_parameters.jpg~|~|alt="setting_parameters.jpg" width="500" height="300"~]~]>>attach:setting_parameters.jpg]]
275 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/setting_parameters.jpg||alt="setting_parameters.jpg" width="500" height="300"]]
257 257  
258 258  \\
259 259  
... ... @@ -286,7 +286,7 @@
286 286  === Data seems not properly saved ===
287 287  
288 288  
289 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/RC_logfile.jpg~|~|alt="RC_logfile.jpg" width="518" height="300"~]~]>>attach:RC_logfile.jpg]]When checking the saved run with the (% class="twikiNewLink" %)DAQdataGUI(%%) it may happen that the property shows up in the data tree but no events are saved. Then (most likely) something is wrong with the sending of the data.
308 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/RC_logfile.jpg||alt="RC_logfile.jpg" width="518" height="300"]]When checking the saved run with the (% class="twikiNewLink" %)DAQdataGUI(%%) it may happen that the property shows up in the data tree but no events are saved. Then (most likely) something is wrong with the sending of the data.
290 290  
291 291  * A very helpful tool is the {{code language="none"}}RC logfile{{/code}}. in the RCGUI on the lower right side there is a button to start an editor with the log file. besides lots of standard entries there is usually also a hint on where to find the problem ...
292 292  * check if the device is working properly. Is it connected? Can you see data in jddd / DOOCS ? . If not you have to fix the DOOCS part ... DAQ can only save what is properly implemented in DOOCS.
... ... @@ -321,7 +321,7 @@
321 321  * if the DAQ gets stuck in the starting or stopping procedure one can try to initialize the DAQ or in the worst case restart it.
322 322  ** to be able to restart the DAQ one has to run jddd on the {{code language="none"}}flashlxuser1{{/code}} or {{code language="none"}}flashlxuser2{{/code}} (up to now (Aug 2018) the restat on our consoles (cons0...12) is NOT possible yet [[image:url:http://hasfweb.desy.de/pub/TWiki/SmiliesPlugin/frown.gif||alt="frown"]]) : log in at one of these machines with your beamline account (e.g. bl1user or fl24user). Start jddd with the {{code language="none"}}jFLASH{{/code}} command. Click on "Photons" -> Experimental Hall "Photons main panel"
323 323  ** The DAQ "expert" panel can be reached from the User DAQ control panel.
324 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQ_expert.jpg~|~|alt="DAQ_expert.jpg" width="400" height="350"~]~]>>attach:DAQ_expert.jpg]]
343 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQ_expert.jpg||alt="DAQ_expert.jpg" width="400" height="350"]]
325 325  
326 326  \\
327 327  
... ... @@ -332,12 +332,12 @@
332 332  ** first one may try the "all to INITIALIZE" button. it starts a script window and asks for the passwd (the beamline accounts (blxuser) should have the according rights. vuvfuser has it for sure. The script sets all subcomponents to initialize. It is helpful if one subcomponent got stuck.
333 333  
334 334  
335 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/UserDAQ_status.jpg~|~|alt="UserDAQ_status.jpg" width="500" height="400"~]~]>>attach:UserDAQ_status.jpg]]
354 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/UserDAQ_status.jpg||alt="UserDAQ_status.jpg" width="500" height="400"]]
336 336  
337 337  \\
338 338  
339 339  * If this does not help you have to "re-start DAQ". This completely restarts all processes and takes a while. A script window appears and shows what steps are actually done. At the end is sais: "Cleanup finished".
340 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQ_restart_msg.jpg~|~|alt="DAQ_restart_msg.jpg" width="400" height="350"~]~]>>attach:DAQ_restart_msg.jpg]]
359 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQ_restart_msg.jpg||alt="DAQ_restart_msg.jpg" width="400" height="350"]]
341 341  
342 342  \\
343 343  
... ... @@ -348,13 +348,13 @@
348 348  * **IF the DAQ still does not work properly** the final option is the: "re-start DAQ (no RCSHM)". This button does the same as the "re-start DAQ" but the Run Controller shared memory is **not** re-stored. It means that after the DAQ is back no run configuration is selected.
349 349  ** in the jddd control the list of subsystems sais "empty"
350 350  ** in the RCGUI in the lower part it sais "RUN mode is not set"
351 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/restart_RCM_no_runmode.jpg~|~|alt="restart_RCM_no_runmode.jpg" width="400" height="400"~]~]>>attach:restart_RCM_no_runmode.jpg]]
370 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/restart_RCM_no_runmode.jpg||alt="restart_RCM_no_runmode.jpg" width="400" height="400"]]
352 352  
353 353  \\
354 354  
355 355  *
356 356  ** one has to go to the "Run Modes" tab and select the run mode {{code language="none"}}FLASH1_EXP{{/code}} by clicking on it !
357 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/runmode_set.jpg~|~|alt="runmode_set.jpg" width="400" height="400"~]~]>>attach:runmode_set.jpg]]
376 +[[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/runmode_set.jpg||alt="runmode_set.jpg" width="400" height="400"]]
358 358  ** then one has to go back to the {{code language="none"}}Subsystems{{/code}} . now all subsystems are included.
359 359  ** finally you have to select your White list and start a run ...
360 360  
... ... @@ -374,7 +374,7 @@
374 374  
375 375  ----
376 376  
377 -[[Some more details for experts ...>>doc:FLASH.Collection of Detailsof the DAQ from various times \.\.\. not for public use]]
396 +[[Some more details for experts ...>>url:http://hasfweb.desy.de/bin/view/Setup/DaqDetails||shape="rect" class="twikiLink"]]
378 378  
379 379  \\
380 380