Changes for page How to save data in the User DAQ
Last modified by sndueste on 2025-09-08 15:36
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -48,7 +48,7 @@ 48 48 49 49 \\ 50 50 51 -* By pressing the start and stop button, besides sending the commands to the DAQ the button prints the panel to the respective beamline / experiments logbook. Here you can later on keep track of the runs. Links to the Beamline logbooks can be found [[here>> doc:FLASHUSER.ElectronicLogbooks]] (DESY internal link)51 +* By pressing the start and stop button, besides sending the commands to the DAQ the button prints the panel to the respective beamline / experiments logbook. Here you can later on keep track of the runs. Links to the Beamline logbooks can be found [[here>>url:http://hasfweb.desy.de/bin/view/Setup/ELogs||shape="rect" class="twikiLink"]] (DESY internal link) 52 52 * After starting, the stop button appears only after saving abut 200 shots to prevent too early stopping which may disturb the DAQ. 53 53 * Each run has a unique run number. This number is needed to retrieve the data later on. So it is important to keep track which number is associated to what experimental parameters. Note that the run numbers are used by all FLASH DAQs (currently about 10). It might thus well be, that two consecutive runs from you do have run numbers which are spaced by more than one if another DAQ has been started in-between ... 54 54 ... ... @@ -96,7 +96,7 @@ 96 96 [[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQgui1.jpg||alt="DAQgui1.jpg" width="500" height="350"]][[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/DAQgui2.jpg||alt="DAQgui2.jpg" width="500" height="350"]][[image:url:http://hasfweb.desy.de/pub/Setup/DAQjddd/daqgui3.png||alt="daqgui3.png" width="500" height="350"]] 97 97 \\ 98 98 99 -The DAQ Data GUI is a general tool to select and visualise data that was saved in the DAQ . It has in addition simple analysis options like histogram, mean, min or max values as function of time etc. Also correlations between different parameters can be analyzed in the tool. More details can be found [[How to Use the FLASH DAQ Data GUI?~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://ttfinfo.desy.de/FLASHWiki/Wiki.jsp?page=FLASHDAQdataGUI||shape="rect"]] and [[ here (DAQdataGUI link collection)>>doc:FLASHUSER.Howtogetthedataout of theDAQ]]99 +The DAQ Data GUI is a general tool to select and visualise data that was saved in the DAQ . It has in addition simple analysis options like histogram, mean, min or max values as function of time etc. Also correlations between different parameters can be analyzed in the tool. More details can be found [[How to Use the FLASH DAQ Data GUI?~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://ttfinfo.desy.de/FLASHWiki/Wiki.jsp?page=FLASHDAQdataGUI||shape="rect"]] and [[here (DAQdataGUI link collection)>>url:http://hasfweb.desy.de/bin/view/Setup/DAQRootGui#How_to_Use_the_FLASH_DAQ_Data_GU||shape="rect" class="twikiAnchorLink"]] 100 100 101 101 The tool (separate Java program) can be started [[DAQdataGUI~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://ttfinfo2.desy.de/common/applications/DAQdataGUI-experimental.jnlp||shape="rect"]] or in the DAQ control panel ( lower right) on your local (Desy) PC. In some cases the access via Windows does not work. An option which should always work is to log onto {{code language="none"}}flashlxuser1{{/code}} or {{code language="none"}}flashlxuser2{{/code}} and start {{code language="none"}}DAQdataGUI{{/code}} from the command line. 102 102 ... ... @@ -113,17 +113,17 @@ 113 113 114 114 === How to get the data out for analysis (short summary) === 115 115 116 -The (% class="twikiNewLink" %)DAQdataGui(%%) is a powerful tool to visualize the saved data and to do very preliminary analysis. however for more detailed analysis the data has to be read into analysis programs ( matlab, python, Origin ...) here are different options one can use (what option is the best and how to set it up has to be discussed before hand with the FLASH DAQ experts ...) 116 +The (% class="twikiNewLink" %)[[DAQdataGui>>url:http://hasfweb.desy.de/bin/edit/Setup/DAQdataGui?topicparent=Setup.DAQjddd;nowysiwyg=0||rel="nofollow" shape="rect"]](%%) is a powerful tool to visualize the saved data and to do very preliminary analysis. however for more detailed analysis the data has to be read into analysis programs ( matlab, python, Origin ...) here are different options one can use (what option is the best and how to set it up has to be discussed before hand with the FLASH DAQ experts ...) 117 117 118 118 * The FLASH DAQ system records the data in binary " {{code language="none"}}.raw{{/code}} " files. 119 -** [[reading the data via Matlab >> doc:FLASHUSER.Data Acquisitionandcontrols.DataAccessat FLASH (DAQ, gpfs,\.\.\.).Offlinedata analysis(DAQ).For experts\: many ways to getData from the DAQ.How to Accessthe DAQ Using Matlab.WebHome]]works not for all data types equally well and needs precise knowledge of the desired Parameters (useful to have a quick look / preliminary analysis on few parameters).120 -** Examples how to read from {{code language="none"}}.raw{{/code}} files can also be found in [[the user code collection>> doc:FLASHUSER.Collectionof user codes]]119 +** [[reading the data via Matlab >>url:http://hasfweb.desy.de/bin/view/Setup/DAQMatlabAccessExamples||shape="rect" class="twikiLink"]]works not for all data types equally well and needs precise knowledge of the desired Parameters (useful to have a quick look / preliminary analysis on few parameters). 120 +** Examples how to read from {{code language="none"}}.raw{{/code}} files can also be found in [[the user code collection>>url:http://hasfweb.desy.de/bin/view/Setup/UserCodeCollection||shape="rect" class="twikiLink"]] 121 121 ** Note that the raw data is only accessible from certain computers within the DESY network and thus not very handy for offline analysis later on ... 122 122 123 123 \\ 124 124 125 125 * To ease the data analysis we IN ADDITION provide //ON REQUEST// the data from the FLASH DAQ as HDF5 format 126 -** ONLINE HDF5s: To make efficient use of the HDF5 files for analysis during the beamtime and afterwards we provide a [[very useful tool (Beamtime Daq Access)>> doc:FLASHUSER.BeamtimeDAQ Access]]. Using this tool (working for Python and Matlab) one can get the data of parameters per run or for specific bunch ID intervals etc. without having to care from which subset of HDF5 files the data is read ...126 +** ONLINE HDF5s: To make efficient use of the HDF5 files for analysis during the beamtime and afterwards we provide a [[very useful tool (Beamtime Daq Access)>>url:http://hasfweb.desy.de/bin/view/Setup/BeamtimeDaqAccess||shape="rect" class="twikiLink"]]. Using this tool (working for Python and Matlab) one can get the data of parameters per run or for specific bunch ID intervals etc. without having to care from which subset of HDF5 files the data is read ... 127 127 ** Summary HDF5 files include complete runs. They will be put after the beamtime on the gpfs storage and are available from computers within DESY (for registered Beamtime participants) and also access 128 128 ** Intro to the [[HDF5 structure used at FLASH>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main||shape="rect" class="twikiLink"]]. This contains also a list of the most used Parameters saved at FLASH for analysis - including the HDF5 names, DOOCS and DAQ names ... 129 129 ** [[Short examples>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main#Samples_how_to_read_HDF5_with_Ma||shape="rect" class="twikiAnchorLink"]] and [[user provided examples>>url:http://hasfweb.desy.de/bin/view/Setup/UserCodeCollection||shape="rect" class="twikiLink"]] on how to read HDF5 in Matlab