Skip to Content
Last modified by sndueste on 2025-09-08 15:36
From version 22.1
edited by cpassow
on 2021-02-10 12:43
Change comment: There is no comment for this version
To version 8.1
edited by sendels
on 2019-08-09 12:22
Change comment: added attachments and links

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.cpassow
1 +XWiki.sendels
Content
... ... @@ -1,7 +1,26 @@
1 +\\
1 1  
3 +* General Concept
4 +* Taking User data: Starting and stopping runs (Users)
5 +** DAQ control panel
6 +** Checklist for proper saving of the data
7 +** More infos on the tools to check the proper saving of the data
8 +** How to get the data out for analysis (short summary)
9 +* Setting up the DAQ - DAQ Run Control GUI (local contacts, FLASH stuff)
10 +** Configuring the DAQ
11 +** Configuring the DAQ monitor
12 +** Start and Stop a run
13 +** Load/Save the configuration
14 +** Assigning the DAQ to the beamline in jddd
15 +** Setting the logbook to print in / putting the Whitelist name in jddd
16 +* In case something goes wrong: Troubleshooting
17 +** No START or STOP buttons are visible in the DAQ control panel
18 +** The DAQ does not start a run
19 +** Data seems not properly saved
20 +** Restarting the DAQ
21 +** what else ???
22 +** Re-read the data base
2 2  
3 -{{toc/}}
4 -
5 5  \\
6 6  
7 7  == General Concept ==
... ... @@ -98,6 +98,7 @@
98 98  
99 99  * The FLASH DAQ system records the data in binary " {{code language="none"}}.raw{{/code}} " files.
100 100  ** [[reading the data via Matlab >>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).For experts\: many ways to get Data from the DAQ.How to Access the DAQ Using Matlab.WebHome]] works not for all data types equally well and needs precise knowledge of the desired Parameters (useful to have a quick look / preliminary analysis on few parameters).
120 +** Examples how to read from {{code language="none"}}.raw{{/code}} files can also be found in [[the user code collection>>doc:FLASH.Collection of user codes]]
101 101  ** Note that the raw data is only accessible from certain computers within the DESY network and thus not very handy for offline analysis later on ...
102 102  
103 103  \\
... ... @@ -115,7 +115,7 @@
115 115  * /asap3/flash/gpfs/ //beamline used// / //year// /data/ //Beamtime application number// /raw/hdf/ (the //Beamtime application number// can be fund in the pdf schedule sent around by Rolf ...)
116 116  * as example: {{code language="none"}}/asap3/flash/gpfs/bl2/2017/data/11003163/raw/hdf/{{/code}}
117 117  
118 -More details and links can be found in the [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.WebHome]].
138 +More details and links can be found in the [[doc:FLASHUSER.User overview]].
119 119  
120 120  \\
121 121  
... ... @@ -189,10 +189,8 @@
189 189  
190 190  === Configuring the DAQ monitor ===
191 191  
192 -The DAQ monitor ( and the Offline monitor) can be configured using DAQdataGUI.
193 -Load a test run containing all relevant properties. Select all properties you want to monitor. Use {{code language="none"}}Tools -> Channels to DAQMonitor{{/code}} and choose your DAQ. This sends a list with the selected properties to the DAQ monitor of your system.
194 -
195 -[[image:attach:daq_monitor_config.png||height="400"]]
212 +The DAQ monitor ( and the Offline monitor) can be confgured using DAQdataGUI.
213 +Load a test run containing all relavant propoerties. Select all properties you want to monitor. Use {{code language="none"}}Tools -> Channels to DAQMonitor{{/code}} and choose your DAQ. This sends a list with the selected properties to the DAQ monitor of your system.
196 196  [[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/daq_monitor_config.png~|~|alt="daq_monitor_config.png" width="700" height="390"~]~]>>attach:daq_monitor_config.png]]
197 197  
198 198  \\
... ... @@ -215,6 +215,10 @@
215 215  
216 216  \\
217 217  
236 +\\
237 +
238 +\\
239 +
218 218  === Load/Save the configuration ===
219 219  
220 220  
... ... @@ -229,24 +229,14 @@
229 229  
230 230  \\
231 231  
232 -=== Choosing the file size ===
254 +\\
233 233  
234 -The DAQ writes into a file (in .raw format) up to a configurable value. If the limit is reached the file will be closed and a new file will be started. Thus a run can contain tens to hundreds of files.
256 +\\
235 235  
236 -The size can be configured to be 100 MB, 350 MB or 1000 MB (default)
258 +=== Assigning the DAQ to the beamline in jddd ===
237 237  
238 -Few things to consider (in case of doubt talk to the expert (Erland ...)):
260 +To assign which DAQ is used at what beamline one has to use the dropdown menu in the {{code language="none"}}parameter monitor{{/code}}. In each Beamline overview tab (BL1,2,3) there is a button (upper right) that starts the {{code language="none"}}parameter monitor{{/code}} panel. In the upper middle is a DAQ field in which the appropriate DAQ can be assigned to the Beamline.
239 239  
240 -* 1000 MB: This is the standard setting which is best for archiving (few large files are preferred). However mainly for images that are saved with less than 10 Hz the HDF5 converter has problems with the large files. And for low data rates it may take upto half an hour to fill one 1GB file. Then smaller ones are also preferable.
241 -* 350 MB: Often a good compromise ...
242 -* 100 MB: It is not preferred to have many "small" files for storing the data. For very small data rates this is an option to not wait too long till the next file is created.
243 -
244 -To choose the desired filesize one has to choose a run mode configuration in the RunControlGUI
245 -
246 -[[~[~[image:attach:image2020-1-17_13-39-38.png~|~|height="400"~]~]>>attach:image2020-1-17_13-39-38.png]]
247 -
248 -This will however the clear the definition of selected subsystems and one has to reload the whitelist of the experiment again.
249 -
250 250  \\
251 251  
252 252  \\
... ... @@ -255,12 +255,6 @@
255 255  
256 256  \\
257 257  
258 -=== Assigning the DAQ to the beamline in jddd ===
259 -
260 -To assign which DAQ is used at what beamline one has to use the dropdown menu in the {{code language="none"}}parameter monitor{{/code}}. In each Beamline overview tab (BL1,2,3) there is a button (upper right) that starts the {{code language="none"}}parameter monitor{{/code}} panel. In the upper middle is a DAQ field in which the appropriate DAQ can be assigned to the Beamline.
261 -
262 -\\
263 -
264 264  === Setting the logbook to print in / putting the Whitelist name in jddd ===
265 265  
266 266  The jddd DAQ Control should be set up that it prints by default the relevant run information in the logbook associated to your beamline [[Logbooks>>doc:FLASH.Electronic Logbooks]]
... ... @@ -327,12 +327,12 @@
327 327  ** 3. In very hard and severe cases there is the ultimate restart button: "re-start DAQ (no RCSHM)"
328 328  
329 329  
330 -\\//**Here in more detail:**//
336 +\\*Here in more detail:*
331 331  
332 332  \\
333 333  
334 334  * if the DAQ gets stuck in the starting or stopping procedure one can try to initialize the DAQ or in the worst case restart it.
335 -** **to be able to restart the DAQ one has to run jddd on the {{code language="none"}}flashlxuser1{{/code}} or {{code language="none"}}flashlxuser2{{/code}} (up to now ( 2020) the restat on our consoles (cons0...12) is NOT possible yet [[image:url:http://hasfweb.desy.de/pub/TWiki/SmiliesPlugin/frown.gif||alt="frown"]]) : log in at one of these machines with your beamline account (e.g. bl1user or fl24user). Start jddd with the {{code language="none"}}flash{{/code}} command. Click on "Photons" -> Experimental Hall "Photons main panel"**
341 +** to be able to restart the DAQ one has to run jddd on the {{code language="none"}}flashlxuser1{{/code}} or {{code language="none"}}flashlxuser2{{/code}} (up to now (Aug 2018) the restat on our consoles (cons0...12) is NOT possible yet [[image:url:http://hasfweb.desy.de/pub/TWiki/SmiliesPlugin/frown.gif||alt="frown"]]) : log in at one of these machines with your beamline account (e.g. bl1user or fl24user). Start jddd with the {{code language="none"}}jFLASH{{/code}} command. Click on "Photons" -> Experimental Hall "Photons main panel"
336 336  ** The DAQ "expert" panel can be reached from the User DAQ control panel.
337 337  [[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQ_expert.jpg~|~|alt="DAQ_expert.jpg" width="400" height="350"~]~]>>attach:DAQ_expert.jpg]]
338 338  
... ... @@ -366,8 +366,9 @@
366 366  \\
367 367  
368 368  *
369 -** one has to go to the "Run Modes" tab and select the run mode {{code language="none"}}FLASH1_EXP{{/code}} by clicking on it and choose the desired file size (stored settings)
370 -** then one has to go back to the {{code language="none"}}Subsystems{{/code}} . initially all subsystems are included.
375 +** one has to go to the "Run Modes" tab and select the run mode {{code language="none"}}FLASH1_EXP{{/code}} by clicking on it !
376 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/runmode_set.jpg~|~|alt="runmode_set.jpg" width="400" height="400"~]~]>>attach:runmode_set.jpg]]
377 +** then one has to go back to the {{code language="none"}}Subsystems{{/code}} . now all subsystems are included.
371 371  ** finally you have to select your White list and start a run ...
372 372  
373 373  \\
... ... @@ -378,21 +378,19 @@
378 378  
379 379  \\
380 380  
388 +=== what else ??? ===
389 +
381 381  \\
382 382  
392 +\\
393 +
383 383  ----
384 384  
385 -== [[Some more details for experts ...>>doc:FLASH.Collection of Detailsof the DAQ from various times \.\.\. not for public use]] ==
396 +[[Some more details for experts ...>>doc:FLASH.Collection of Detailsof the DAQ from various times \.\.\. not for public use]]
386 386  
387 -=== Re-read the data base ===
388 -
389 -If there are new Properties included by Vladimir et al one has to reread the data base.
390 -
391 -This can be done easiest by going to the run modes and choose a different "stored setting" (changing e.g. from filesize 100 MB to 350 MB) and going back to subsystems. At this point the new database entries are read in. then one can do the same backwards to switch back to the initial file size. Doing this the configured list of subsystems is lost and one has to reload the whitelist and start a run to get the loaded whitelist in the configuration.
392 -
393 393  \\
394 394  
395 -OR one can do the hard way:
400 +=== Re-read the data base ===
396 396  
397 397  On flashlxuser1 or 2 start RCGUIFL1USER1 or appropriate to the DAQ you want to reconfigure. Select the tab "Run Modes". To then reload or re-init the run control database you need the expert menu entry:
398 398  
... ... @@ -405,25 +405,3 @@
405 405  {{code language="none"}}"expert" -> "Run Control Commands" -> "Re-init SHM"{{/code}}
406 406  
407 407  Now close the RCGUI and start it again. Switch to the tab "subsystems", wait for the subsystems to be reloaded and load the whitelist you want to use.
408 -
409 -\\
410 -
411 -Tracking DAQ restarts
412 -
413 -A system was implemented (March 2020) where each restart of a user DAQ is recorded in a log file
414 -
415 -One can see all log files in :
416 -
417 -/home/doocsadm/bm/rcdb/restartslog/
418 -
419 -=== data base errors ===
420 -
421 -The red flags next to the  different stream indicators tell something about data base errors
422 -
423 -[[image:url:https://mail.desy.de/service/home/~~/?auth=co&loc=de&id=154203&part=2.2||width="788" height="140"]]
424 -
425 -upper flag:  There was a problem to read run catalogue
426 -
427 -lower flag: There was a problem to read dccp catalogue.
428 -
429 -In both cases there are counters of failures to read a catalogue. If this counter is not incrementing with every attempt to read a catalogue, then it's no problem. It can be monitored and reset in the panel that one gets by pressing on "green" area.