Changes for page The FLASH HDF5 structure
Last modified by sndueste on 2025/02/06 10:55
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -8,9 +8,9 @@ 8 8 9 9 == General information about HDF5 == 10 10 11 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https:// www.hdfgroup.org/HDF5/||shape="rect"]]11 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]] 12 12 13 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https:// support.hdfgroup.org/products/java/hdfview/index.html||shape="rect"]]13 +To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]] 14 14 15 15 For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module : 16 16 {{code language="none"}}> module load xray{{/code}} ... ... @@ -18,26 +18,99 @@ 18 18 19 19 [[Contents>>doc:||anchor="Contents"]] 20 20 21 -== FLASHHDF5structure==21 +== The new (starting 2021) HDF5 format == 22 22 23 - The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organised according to train IDs. The general structure is:23 +\\ 24 24 25 +FLASH provides a conversion of its data acquisition (DAQ) to the commonly used [[HDF5>>url:https://www.hdfgroup.org/solutions/hdf5/||shape="rect"]] format. Correlated data are mapped by a primary index called **train ID**. Every data set has an individual index of train IDs to identify the data even when data are missing or deviate in update rate.If the data set of choice contains gaps, users have to decide how to treat missing values. DAQ channels are spread across various files with one file name pattern for each DAQ. This means users have to assemble data from different files if necessary. 26 + 27 +The hierarchy is realized using a human readable named HDF tree with each DAQ channel containing the data sets "//value//" and "//index//". Additionally, the HDF group //zraw// contains a tree of the original DAQ channel names. 28 + 29 +Reference implementation, which follows the concept of Python libraries like Pandas, Xarray, or Dask, is given below. 30 + 31 +\\ 32 + 33 +{{expand title="Discontinued HDF formats"}} 34 +== Comparison to FLASH's deprecated HDF formats == 35 + 36 +Before 2021, FLASH provided two different HDF formats formally known as //near-online// and //offline// HDF files. 37 + 38 +All data sets were aligned by the same global index by filling in missing data. Fast DAQ channels (pulse synchronous data - update 10 Hz) are filled in by NaN or 0, slow channels (not pulse synchronous data - update e.g. 1 Hz ) are interpolated by the DAQs libraries, by keeping the value constant up to the next change. 39 + 40 +While the near-online HDF files were converted live during the beamtime, the offline HDF files were manually compiled weeks/months later. Near-online HDF files were used by a provided API [[BeamtimeDaqAccess>>url:https://confluence.desy.de/display/FLASHUSER/Near-Online+data+analysis#Near-Onlinedataanalysis-BriefUserGuidetoBeamtimeDAQAccess||shape="rect"]], which also searches for DAQ channels in files. With assembled files "by run", all DAQ channels were existing in the same HDF file. While shorter runs usually fitted into one file, longer runs still had to be aggregated over several files. The creation of the assembled type of files still involves the use of fairly unstable DAQ Mex-functions As the environment required for using the Mex-functions is already deprecated, its continued existence is uncertain. 41 + 42 +The HDF hierarchy is almost identical in all formats. While in the the recent format each DAQ channel contains the data sets "value" and "index", the deprecated format had one data set for each DAQ channel. The deprecated formats supplies no time axis parameters for spectra data types. 43 +{{/expand}} 44 + 45 +== HDF excerpt: == 46 + 47 +* ADC data as example for **fast** **data** (10 Hz): [[image:attach:image2020-11-16_15-26-28.png||height="250"]] 48 +* The //average// FEL pulse energy as example for the **slow** **data** (different e.g. 1 Hz):[[image:attach:image2020-11-16_15-31-45.png||height="250"]] 49 + 50 + ( every 10th train ID is listed in the HDF group "index") 51 + 52 +* ((( 53 +//zraw// group contains the **original DAQ (DOOCS) names[[image:attach:image2020-11-16_16-26-3.png||thumbnail="true" height="250"]]** 54 +))) 55 + 56 + of the properties saved in the DESY internal raw format. (For experts) 57 + 58 +\\ 59 + 60 +\\ 61 + 62 +{{info title="Sample scripts in python"}} 63 +== Reference implementation (Python) == 64 + 65 +[[~[~[image:attach:binder_badge.png~|~|thumbnail="true" width="120"~]~]>>url:https://mybinder.org/v2/git/https%3A%2F%2Fgitlab.desy.de%2Fchristopher.passow%2Fflash-daq-hdf/master||shape="rect"]] 66 + 67 +(% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]] 68 +{{/info}} 69 + 70 +\\ 71 + 72 +\\ 73 + 74 +== The discontinued (till 2021) FLASH HDF5 structure == 75 + 76 +The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organized according to train IDs. The general structure is: 77 + 25 25 * Electron Diagnostic 26 26 * Photon Diagnostics 27 27 * Beamlines 28 28 * Experiment 29 29 * Timing 30 -[[ ~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg~|~|alt="HDF5_structure.jpg" width="700" height="500"~]~]>>attach:HDF5_structure.jpg]]83 +[[image:attach:HDF5_structure.jpg||height="400"]] 31 31 32 -A detail led description of (most) channels can be found in the lower part of the hdf5 viewer:33 -[[ ~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg~|~|alt="HDF5_structure_desc.jpg"width="341" height="413"~]~]>>attach:HDF5_structure_desc.jpg]]85 +A detailed description of (most) channels can be found in the lower part of the hdf5 viewer: 86 +[[image:attach:HDF5_structure_desc.jpg||thumbnail="true" height="250"]] 34 34 35 35 [[Contents>>doc:||anchor="Contents"]] 36 36 37 37 \\ 38 38 39 -== Most popular FLASHparametersand their namesin HDF5, DOOCS and(raw)DAQ==92 +=== HDF5 example files (old format) === 40 40 94 +Here we have a few HDF5 samples (User data combined with Photon diagnostics data) from a few beamtimes showing the different kind options. 95 + 96 +[[image:attach:image2019-10-21_17-2-50.png||thumbnail="true" width="300"]] [[download HDF5 (Images @ FL2)>>url:https://desycloud.desy.de/index.php/s/nyEgeCWJFC4gao2||shape="rect"]] 97 + 98 +\\ 99 + 100 +[[~[~[image:attach:image2019-10-22_10-52-27.png~|~|thumbnail="true" width="300"~]~]download HDF5 (GHz ADC and OPIS @ FL2)>>url:https://desycloud.desy.de/index.php/s/AeA2kPNNnZgX95A||shape="rect"]] 101 + 102 +\\ 103 + 104 +\\ 105 + 106 +[[Contents>>doc:||anchor="Contents"]] 107 + 108 +\\ 109 + 110 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ == 111 + 112 +{{id name="DOOCSparameters"/}} 113 + 41 41 The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]]. 42 42 The most common and often used ones are summarized below: 43 43 ... ... @@ -79,7 +79,7 @@ 79 79 //always saved (PBD)// 80 80 DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}} 81 81 DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}} 82 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]155 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]] 83 83 units: degree 84 84 \\ 85 85 ... ... @@ -87,7 +87,7 @@ 87 87 //always saved (PBD)// 88 88 DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}} 89 89 DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}} 90 -desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]163 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]] 91 91 units: degree 92 92 \\ 93 93 ... ... @@ -117,27 +117,33 @@ 117 117 \\ 118 118 119 119 120 -NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact193 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. For more Info contact your local contact 121 121 122 122 [[Contents>>doc:||anchor="Contents"]] 123 123 124 124 \\ 125 125 126 -==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) / Spectrometer (FLASH1)====199 +==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) ==== 127 127 201 +\\ 202 + 203 +(% style="color: rgb(0,0,0);" %)**Discontinued GMD data recording / evaluation (VME + PhotonFlux ML server)** 204 + 128 128 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}} 129 -//always saved (PBD)// 130 -DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} 131 -DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}} 132 -desc : calibrated average SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current) 206 +//always saved (PBD)// 207 + 208 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} (%%) 209 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}(%%) 210 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator (ion current) 133 133 units : microJ 134 134 135 135 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}} 136 -//always saved (PBD)// 214 +//always saved (PBD)// 215 + 137 137 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}} 138 138 DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}} 139 139 desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL 140 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 219 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 141 141 142 142 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}} 143 143 //always saved (PBD)// ... ... @@ -144,10 +144,11 @@ 144 144 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}} 145 145 DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}} 146 146 desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise 147 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 226 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 148 148 149 149 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}} 150 -//always saved (PBD)// 229 +//always saved (PBD)// 230 + 151 151 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT05/VAL{{/code}} 152 152 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENPULSEIC{{/code}} 153 153 desc : calibrated average SASE Energy/pulse measured in the BDA (in the experimental hall) after the attenuator (ion current) ... ... @@ -154,11 +154,12 @@ 154 154 units : microJ 155 155 156 156 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA{{/code}} 157 -//always saved (PBD)// 237 +//always saved (PBD)// 238 + 158 158 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}} 159 159 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}} 160 160 desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL 161 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 242 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 162 162 163 163 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}} 164 164 //always saved (PBD)// ... ... @@ -165,13 +165,64 @@ 165 165 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}} 166 166 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}} 167 167 desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise 168 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 249 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 169 169 251 +\\ 252 + 253 +(% style="color: rgb(0,0,0);" %)**NEW (2021) GMD data recording / evaluation (MTCA, analog to FLASH2 and XFEL)** 254 + 255 +{{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}} 256 +//always saved (PBD)// 257 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%) 258 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} 259 + 260 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator 261 +units : microJ 262 + 263 +\\ 264 + 265 +{{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}} 266 +//always saved (PBD)// 267 + 268 +(% style="color: rgb(0,0,0);" %)DOOCS prop : 269 +{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}} 270 + 271 +desc : Energy per pulse measured in the Tunnel. In addition measurement errors and beam position are included for EACH pulse in the pulse train !! (see below) 272 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 273 + 274 +{{info title="GMD pulse resolved data structure"}} 275 +For every pulse in the pulse train the information is saved: 276 + 277 + 278 +1. **Intensity per pulse** (a.u. (more or less µJ )) 279 +1. Intensity per pulse (auxillary GMD) - not used 280 +1. Position horizontal (mm, for a single pulse the position information may be very noisy - talk to your local contact) 281 +1. Position vertical (mm, for a single pulse the position information may be very noisy - talk to your local contact) 282 +1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)) 283 +1. Position horizontal sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 284 +1. Position vertical sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 285 +1. Combined warning and error flags 286 + 287 +The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 288 +file 289 + 290 + 291 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]] 292 + 293 +\\ 294 +{{/info}} 295 + 296 +All values for the GMD are also available for the** BDA GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between BDA and Tunnel signal shows the attenuation. **BUT NOTE** that the filter units are downstream the GMD. So if filters are used this influence is NOT measured by the GMD BDA ! 297 + 298 +\\ 299 + 300 +Besides pulse energy the GMD also provides information about the beam position 301 + 170 170 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}} 171 171 //always saved (PBD)// 172 172 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}} 173 173 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}} 174 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.GasMonitor Detector]](BDA, x=horizontal)306 +desc :Beam position of the photon Beam determined by the GMD (BDA, x=horizontal) 175 175 units : mm 176 176 177 177 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}} ... ... @@ -178,7 +178,7 @@ 178 178 //always saved (PBD)// 179 179 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}} 180 180 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}} 181 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.GasMonitor Detector]](BDA, y=vertical)313 +desc :Beam position of the photon Beam determined by the GMD (BDA, y=vertical) 182 182 units : mm 183 183 184 184 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}} ... ... @@ -185,7 +185,7 @@ 185 185 //always saved (PBD)// 186 186 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}} 187 187 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}} 188 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.GasMonitor Detector]](TUNNEL, x=horizontal)320 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, x=horizontal) 189 189 units : mm 190 190 191 191 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}} ... ... @@ -192,9 +192,13 @@ 192 192 //always saved (PBD)// 193 193 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}} 194 194 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}} 195 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.GasMonitor Detector]](TUNNEL, y=vertical)327 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical) 196 196 units : mm 197 197 330 +\\ 331 + 332 +==== Spectrometer (FLASH1) ==== 333 + 198 198 {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}} 199 199 _always saved (when Spectrum is measured !!) (PBD) _ 200 200 DOOCS prop : {{code language="none"}}TTF2.EXP/PHOTONWL.ML/WAVE_LENGTH/VAL.TD{{/code}} ... ... @@ -278,10 +278,25 @@ 278 278 //always saved (PBD)// 279 279 DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}} 280 280 DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}} 281 -desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data) 282 -units: ps (bigger numbers indicate later arrivaltime of the electrons) 283 -note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]] 417 +desc: Electron bunch arrival time measured with the BAM inside the accelerator - however shows a very good correlation to the arrivaltime of the XUV pulses in the experiment (pulse resolved data). 418 +units: ps (bigger numbers indicate later arrivaltime of the electrons) 284 284 420 +{{code language="none"}}/FL1/Electron Diagnostic/BAM/1SFELC/electron bunch arrival time (low charge){{/code}} 421 +//always saved (PBD)// 422 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/1SFELC/LOW_CHARGE_ARRIVAL_TIME{{/code}} 423 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/1SFELC.LOW_CHARGE_ARRIVAL_TIME{{/code}} 424 +desc: Electron bunch arrival time measured with the BAM before the undulator (pulse resolved data). This one was newly installed in 2020. 425 +units: ps (bigger numbers indicate later arrivaltime of the electrons) 426 + 427 +{{info title="BAM hints"}} 428 +* besides the arrivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved.In case of doubt ask your local contact 429 +* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]] 430 +* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] 431 +* a recent [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]] 432 +{{/info}} 433 + 434 +\\ 435 + 285 285 ===== electron beam profile ===== 286 286 287 287 {{code language="none"}}/FL1/Electron Diagnostic/Electron bunch profile/TDS profile{{/code}} ... ... @@ -310,7 +310,7 @@ 310 310 ===== electron bunch energy ===== 311 311 312 312 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/average electron energy{{/code}} 313 - _always saved (PBD)464 +//always saved (PBD)// 314 314 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_INTRA_MEAN/VAL{{/code}} 315 315 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_MEAN{{/code}} 316 316 desc: electron bunch energy (average over the bunch train) ... ... @@ -318,7 +318,7 @@ 318 318 \\ 319 319 320 320 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/pulse resolved energy{{/code}} 321 - _always saved (PBD)472 +//always saved (PBD)// 322 322 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_SPECT/VAL.TD{{/code}} 323 323 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_SPECT{{/code}} 324 324 desc: electron bunch energy bunch resolved ... ... @@ -327,7 +327,7 @@ 327 327 \\ 328 328 329 329 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/wavelength bunch train average{{/code}} 330 - _always saved (PBD)481 +//always saved (PBD)// 331 331 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/LAMBDA_MEAN/VAL{{/code}} 332 332 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/LAMBDA_MEAN{{/code}} 333 333 desc: Wavelength calculated by the electron bunch energy (average over the bunch train) (FLASH1) ... ... @@ -385,7 +385,7 @@ 385 385 //always saved (PBD)// 386 386 DOOCS prop : {{code language="none"}}none{{/code}} 387 387 DAQ channel: {{code language="none"}}none{{/code}} 388 -desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !) 539 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 data set the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !) 389 389 units: 390 390 \\ 391 391 ... ... @@ -392,7 +392,7 @@ 392 392 ===== Train time ===== 393 393 394 394 {{code language="none"}}/Timing/train time{{/code}} 395 -desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visuali sation purposes only. For correlations use the train ID or the Unix time of the time stamp546 +desc:Local time as array of day, hour, minute, second, and centisecond. This data set is meant for visualization purposes only. For correlations use the train ID or the Unix time of the time stamp 396 396 units: d h min s cs 397 397 \\ 398 398 ... ... @@ -458,9 +458,15 @@ 458 458 459 459 ==== User Data (FLASH1) ==== 460 460 612 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact. 613 + 614 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names 615 + 616 +The most common and permanently installed device used by experiment are our ADCs: 617 + 461 461 ===== GHz ADCs ===== 462 462 463 -ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]] 620 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]** 464 464 //saved on DEMAND in the user DAQ// 465 465 \\The HDF5 names for the ADC traces are depending on the beamline : 466 466 \\PG Beamline: ... ... @@ -483,14 +483,12 @@ 483 483 here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly. 484 484 DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}} 485 485 486 - in addition there are also additional parameters saved like:643 +In addition there are also additional parameters saved like: 487 487 488 -* sample frequency (in MHz)489 -* e rror(state)490 -* o ffset645 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains. 646 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger 647 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error 491 491 492 -~| 493 - 494 494 ===== MHz ADCs ===== 495 495 496 496 similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like: ... ... @@ -498,10 +498,19 @@ 498 498 DOOCS prop : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02/CH00.TD 499 499 DAQ channel: : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02 500 500 501 - \\656 +In addition there are also additional parameters saved like: 502 502 658 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains. 659 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger 660 + 503 503 [[Contents>>doc:||anchor="Contents"]] 504 504 663 +\\ 664 + 665 +\\ 666 + 667 +\\ 668 + 505 505 === FLASH2 === 506 506 507 507 There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs ... ... @@ -508,12 +508,12 @@ 508 508 509 509 ==== Beamline info (FLASH2) ==== 510 510 511 - (% style="color: rgb(255,153,0);" %)(not yet available){{code language="none"}}/FL2/Beamlines/Attenuator/pressure(%%)512 -//always saved (PBD2)// 513 -DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} 514 -DAQ channel: {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} 515 -desc: set pressure in the gas attenuator 516 -units: mbar 675 +{{code language="none"}}/FL2/Beamlines/Attenuator/pressure {{/code}} 676 +(% style="color: rgb(0,0,0);" %)//always saved (PBD2)// (%%) 677 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%) 678 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%) 679 +(% style="color: rgb(0,0,0);" %)desc: set pressure in the gas attenuator (%%) 680 +(% style="color: rgb(0,0,0);" %)units: mbar(%%) 517 517 \\ 518 518 519 519 {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}} ... ... @@ -528,15 +528,17 @@ 528 528 //always saved (PBD2)// 529 529 DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}} 530 530 DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS 531 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]695 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]** 532 532 units: degree 533 533 \\ 534 534 699 +/FL2/Beamlines/Filter wheel/position wheel 2 700 +always saved (PBD2) 701 +DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}} 702 +DAQ channel: {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}} 703 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]] 704 +units: degree 535 535 536 -//always saved (PBD2)// 537 -\\\\[[here>>doc:FLASH.Filter history (BL filterwheel 12)]] 538 -{{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2 DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}} 539 - 540 540 \\ 541 541 542 542 NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact ... ... @@ -558,40 +558,37 @@ 558 558 559 559 \\ 560 560 561 -(% style="color: rgb(255,204,0);" %)average Sigma to be included in 562 - 563 -(% style="color: rgb(193,199,208);" %){{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel uncertainty{{/code}} (%%) 564 -(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%) 565 -(% style="color: rgb(193,199,208);" %)DOOCS prop : FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%) 566 -(% style="color: rgb(193,199,208);" %)DAQ channel: FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%) 567 -(% style="color: rgb(193,199,208);" %)desc : This parameter gives an indication of the error of the measurement of the average pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%) 568 -(% style="color: rgb(193,199,208);" %)units : microJ 569 - 570 -\\ 571 - 572 -\\ 573 - 574 574 {{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}} 575 575 //always saved (PBD2)// 576 576 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}} 577 577 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}} 578 -desc : Energy per pulse measured in the Tunnel (in fro mt of the gas attenuator and the apertures in the Hall)579 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 731 +desc : Energy per pulse measured in the Tunnel (in front of the gas attenuator and the apertures in the Hall) In addition measurement errors and beam position are included for EACH pulse in the pulse train !! (see below) 732 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 580 580 581 -\\ 734 +{{info title="GMD pulse resolved data structure"}} 735 +For every pulse in the pulse train the information is saved: 736 + 582 582 583 -\\ 738 +1. **Intensity per pulse** (a.u. (more or less µJ )) 739 +1. Intensity per pulse (auxillary GMD) - not used 740 +1. Position horizontal (mm, for a single pulse the position information may be very noisy - talk to your local contact) 741 +1. Position vertical (mm, for a single pulse the position information may be very noisy - talk to your local contact) 742 +1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)) 743 +1. Position horizontal sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 744 +1. Position vertical sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 745 +1. Combined warning and error flags 584 584 585 -{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel uncertainty (sigma){{/code}} 586 -//always saved (PBD2)// 587 -DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.SIGMA.TD{{/code}} 588 -DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:4{{/code}} 589 -desc :(% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%) 590 -units : a.u. (more or less µJ - related to the value of the pulse energy ) 747 +The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 748 +file 591 591 750 + 751 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]] 592 592 593 -{{code language="none"}}{{/code}} 753 +\\ 754 +{{/info}} 594 594 756 +\\ 757 + 595 595 All values for the GMD are also available for the** HALL GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between Hall and Tunnel signal shows the attenuation. **BUT NOTE** that the filter unit and the Aperture 4 are downstream the GMD. So if filters and aperture are used this influence is NOT measured by the GMD hall ! 596 596 597 597 \\ ... ... @@ -604,7 +604,7 @@ 604 604 //always saved (PBD2)// 605 605 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}} 606 606 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}} 607 -desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.GasMonitor Detector]](tunnel, x=horizontal)770 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal) 608 608 units : mm 609 609 610 610 \\ ... ... @@ -613,18 +613,20 @@ 613 613 //always saved (PBD2)// 614 614 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}} 615 615 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}} 616 -desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.GasMonitor Detector]](tunnel, x=horizontal)779 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal) 617 617 units : mm 618 618 619 619 \\ 620 620 784 +/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x 785 +always saved (PBD2) 786 +DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TD 787 +DAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 788 +desc: Besides the well calibrated averaged beam position information there is also the option to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...) 789 +units : mm 621 621 622 -//always saved (PBD2)// 623 -\\\\{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TDDAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 desc: {{/code}}Besides the well calibrated averaged beam position information there is also the option 624 -{{code language="none"}}to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...)units : mm {{/code}} 791 +(x=horizontal, y = vertial) 625 625 626 -{{code language="none"}}(x=horizontal, y = vertial){{/code}} 627 - 628 628 again the same parameter set is available for the **HALL GMD** 629 629 630 630 \\ ... ... @@ -631,9 +631,9 @@ 631 631 632 632 \\ 633 633 634 -==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ==== 799 +==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ==== 635 635 636 -for more info see: [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]] 801 +for more info see:** [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]** 637 637 638 638 (The OPIS hall is not installed yet ...) 639 639 ... ... @@ -670,7 +670,7 @@ 670 670 671 671 \\ 672 672 673 -In case OPIS was not operating there is still informaton about the set wavelength for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ... 838 +In case OPIS was not operating there is still informaton about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ... 674 674 675 675 \\ 676 676 ... ... @@ -684,7 +684,7 @@ 684 684 //always saved (PBD2)// 685 685 DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}} 686 686 DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}} 687 -desc: electron bunch charge (FLASH2)852 +desc: electron bunch charge FLASH2 (average value for each bunchtrain). 688 688 units: nC 689 689 690 690 \\ ... ... @@ -702,74 +702,71 @@ 702 702 //always saved (PBD2)// 703 703 DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}} 704 704 DAQ channel: {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}} 705 -desc: Sgap value of theUndulators.this can be used to follow up how many undulators were closed and if there was a taper870 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper 706 706 units: mm 707 707 708 -The gap values are saved for all 12 undulators (Nr 3 to 14) 873 +The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall. 709 709 710 710 ===== 711 711 arrival time ===== 712 712 878 +{{code language="none"}}/FL2/Electron Diagnostic/BAM/8FL2XTDS/electron bunch arrival time (low charge){{/code}} 879 +//always saved (PBD2)// 880 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/8FL2XTDS/LOW_CHARGE_ARRIVAL_TIME{{/code}} 881 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/8FL2XTDS.LOW_CHARGE_ARRIVAL_TIME{{/code}} 882 +desc: Electron bunch arrival time measured with the BAM after the FLASH2 undulator (pulse resolved data) 883 +units: ps (bigger numbers indicate later arrivaltime of the electrons) 884 + 713 713 **FL1**{{code language="none"}}//Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}} 714 714 //always saved (PBD2)// 715 715 DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}} 716 716 DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}} 717 -desc: Electron bunch arrival time measured with the BAM (moreor less) beforetheundulator (pulse resolved data)889 +desc: Electron bunch arrival time measured with the BAM in the accelerator (pulse resolved data) 718 718 units: ps (bigger numbers indicate later arrivaltime of the electrons) 719 719 720 -The BAM measures the arrivaltime of FLASH 1 and FLASH2 in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches. 721 - 722 722 \\ 723 723 724 -first bunch of FLASH2 ... how to calculate .. 894 +{{info title="BAM hints"}} 895 +* The BAM 4DBC3 measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). 896 +* The BAM 8FL2XTDS measures only for FLASH2 BUT has the same data structure as the other BAMS ... thus there are also (random) values in in the FLASH1 time slot 897 +** Structure: The first values are for FLASH1 bunches. After a gap of about 70 micros ( 70 colums) with as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start. The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ... .In case of doubt ask your local contact 898 +* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]] 899 +* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] 900 +* a recent [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]] 901 +{{/info}} 725 725 726 -\\ 727 727 728 - \\904 +[[Contents>>doc:||anchor="Contents"]] 729 729 730 -Docu: [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]] 731 - 732 732 \\ 733 733 734 - \\908 +==== Timing information, rep rate etc. (FLASH2) ==== 735 735 736 - \\910 +===== start time of FLASH2 ===== 737 737 912 +{{code language="none"}}/FL2/Timing/start time flash2{{/code}} 913 +//always saved (PBD2)// 914 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}} 915 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}} 916 +desc: The max 600 µs acceleration time of FLASH is devided between FLASH1 and FLASH2. This 600 µs window starts with FLASH1 (up to now) at a time"label" of 700 µs (for historic reasons). Thus the first bunch of FLASH 1 comes at "700" and the last possibel bunch comes at 1300 (700+600). After FLASH1 train is over ther is a about 70µs switching time with no bunches. Then comes the first FLASH2 bunch. Thus if e.g. the start time of FLASH2 is 1200 it means that FLASH2 starts at column 500 (1200-700) in the HDF5 files. (However for yet unknown reasons this may change by 2-3 colums ...) 917 +units: µs 738 738 739 -\\ 740 - 741 -[[Contents>>doc:||anchor="Contents"]] 742 - 743 -\\ 744 - 745 -==== Timing information, rep rate etc. (FLASH1) ==== 746 - 747 747 ===== bunch repetition rate ===== 748 748 749 -{{code language="none"}}/FL 1/Timing/repetition rate{{/code}}750 -//always saved (PBD)// 751 -DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ. 1{{/code}}752 -DAQ channel: TTF2.UTIL/LASER.CONTROL/GUN/PULSE_FREQ{{/code}}753 -desc: repetition rate of the bunches / pulses within the burst (FLASH 1)921 +{{code language="none"}}/FL2/Timing/repetition rate{{/code}} 922 +//always saved (PBD2)// 923 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}} 924 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}} 925 +desc: repetition rate of the bunches / pulses within the burst (FLASH2) 754 754 units: kHz 755 -\\ 756 756 757 -===== set number of pulses ===== 758 - 759 -{{code language="none"}}/FL1/Timing/set number of bunches{{/code}} 760 -//always saved (PBD)// 761 -DOOCS prop : {{code language="none"}}FLASH.DIAG/TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH1{{/code}} 762 -DAQ channel: {{code language="none"}}TTF2.UTIL/LASER.CONTROL/GUN/PULSE_NUM{{/code}} 763 -desc: Number of pulses set at the gun (FLASH1) 764 -units: 765 - 766 766 ===== actual number of pulses ===== 767 767 768 768 {{code language="none"}}/FL1/Timing/actual number of bunches{{/code}} 769 -//always saved (PBD)// 770 -DOOCS prop : {{code language="none"}}FLASH.DIAG/TOROID.ML/ 12EXP/NUMBEROFBUNCHES.FLASH1{{/code}}771 -DAQ channel: {{code language="none"}} TTF2.DIAG/PBD.TOROID.ML/12EXP{{/code}}772 -desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH 1)931 +//always saved (PBD2)// 932 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}} 933 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}} 934 +desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH2) 773 773 units: 774 774 \\ 775 775 ... ... @@ -776,10 +776,10 @@ 776 776 ===== actual pulse pattern recorded after the undulator ===== 777 777 778 778 {{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}} 779 -//always saved (PBD)// 780 -DOOCS prop : {{code language="none"}} TTF2.DIAG/PBD.TOROID.ML/12EXP/CHARGE.TD{{/code}}781 -DAQ channel: {{code language="none"}} TTF2.DIAG/PBD.TOROID.ML/12EXP{{/code}}782 -desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH 1)941 +//always saved (PBD2)// 942 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}} 943 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}} 944 +desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH2) 783 783 units: 784 784 \\ 785 785 ... ... @@ -786,7 +786,7 @@ 786 786 ===== Train ID ===== 787 787 788 788 {{code language="none"}}/Timing/train ID{{/code}} 789 -//always saved (PBD)// 951 +//always saved (PBD2)// 790 790 DOOCS prop : {{code language="none"}}none{{/code}} 791 791 DAQ channel: {{code language="none"}}none{{/code}} 792 792 desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !) ... ... @@ -795,13 +795,16 @@ 795 795 796 796 ===== Train time ===== 797 797 798 -{{code language="none"}}/Timing/train time{{/code}} 960 +//always saved (PBD2) 961 +//{{code language="none"}}/Timing/train time{{/code}} 799 799 desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp 800 800 units: d h min s cs 801 801 \\ 802 802 803 -{{code language="none"}}/Timing/time stamp{{/code}} 804 -desc:first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc 966 +{{code language="none"}}/Timing/time stamp{{/code}} 967 + 968 +//always saved (PBD2)// 969 +desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc 805 805 second column: microseconds 806 806 third column: Train ID of FLASH 807 807 \\ ... ... @@ -810,209 +810,102 @@ 810 810 811 811 \\ 812 812 813 - \\978 +==== User Data (FLASH2) ==== 814 814 980 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact. 981 + 982 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names 983 + 984 +The most common and permanently installed device used by experiment are our ADCs: 985 + 986 +===== GHz ADCs ===== 987 + 988 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]** 989 +//saved on DEMAND in the user DAQ// 990 +\\Up to now there are 4 channels available at FL24 991 +\\\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD{{/code}} 992 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH01/TD{{/code}} 993 +\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH02/TD{{/code}}{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH03/TD{{/code}} 994 + 815 815 \\ 816 816 997 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00/CH00.TD or CH00.DAQ.TD{{/code}} 998 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly. 999 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00{{/code}} 1000 + 1001 +In addition there are also additional parameters saved like: 1002 + 1003 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains. 1004 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger 1005 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error 1006 +* {{code language="none"}}/CH0-CH3/offset{{/code}}: To use the full dynamic range of the ADC one can shift the base line . This offset is saved here. 1007 + 1008 +===== MHz ADCs ===== 1009 + 1010 +similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like: 1011 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH2/TD{{/code}} 1012 +DOOCS prop : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02/CH00.TD 1013 +DAQ channel: : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02 1014 + 1015 +In addition there are also additional parameters saved like: 1016 + 1017 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains. 1018 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger 1019 + 1020 +[[Contents>>doc:||anchor="Contents"]] 1021 + 817 817 \\ 818 818 819 819 \\ 820 820 1026 +==== Pump Probe Laser (FLASH2) ==== 1027 + 1028 +There may be more information available from the "Laser DAQ". laese contact your Laser Local Contact. 1029 + 1030 + 1031 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/attenuator position{{/code}}//always saved (PBD2)// 1032 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}} 1033 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}} 1034 +desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate) 1035 +units : deg. 1036 + 821 821 \\ 822 822 1039 + 1040 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/polarization position{{/code}}//always saved (PBD2)// 1041 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}} 1042 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}} 1043 +desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate) 1044 +units : deg. 1045 + 823 823 \\ 824 824 825 -(% class="wrapped" %) 826 -|=((( 827 -DAQ name 828 -)))|=((( 829 -HDF5 name 830 -))) 831 -|((( 832 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP 833 -)))|((( 834 -/FL2/Electron Diagnostic/Undulator setting/SASE03 gap 835 -))) 836 -|((( 837 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP 838 -)))|((( 839 -/FL2/Electron Diagnostic/Undulator setting/SASE14 gap 840 -))) 841 -|((( 842 -TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH 843 -)))|((( 844 -/FL2/Electron Diagnostic/Undulator setting/set wavelength 845 -))) 846 -|((( 847 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX.UJ 848 -)))|((( 849 -/FL2/Photon Diagnostic/GMD/Average energy/hall 850 -))) 851 -|((( 852 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX 853 -)))|((( 854 -/FL2/Photon Diagnostic/GMD/Average energy/hall (raw) 855 -))) 856 -|((( 857 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ 858 -)))|((( 859 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel 860 -))) 861 -|((( 862 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX 863 -)))|((( 864 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel (raw) 865 -))) 866 -|((( 867 -FLASH.FEL/XGM.POSMON/FL2.HALL/IX.POS 868 -)))|((( 869 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall horizontal 870 -))) 871 -|((( 872 -FLASH.FEL/XGM.POSMON/FL2.HALL/IY.POS 873 -)))|((( 874 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall vertical 875 -))) 876 -|((( 877 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS 878 -)))|((( 879 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel horizontal 880 -))) 881 -|((( 882 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS 883 -)))|((( 884 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel vertical 885 -))) 886 -|((( 887 -FLASH.FEL/XGM.BPM/FL2.HALL:0 888 -)))|((( 889 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall horizontal 890 -))) 891 -|((( 892 -FLASH.FEL/XGM.BPM/FL2.HALL:1 893 -)))|((( 894 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall vertical 895 -))) 896 -|((( 897 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:0 898 -)))|((( 899 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel horizontal 900 -))) 901 -|((( 902 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:1 903 -)))|((( 904 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical 905 -))) 906 -|((( 907 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:1 908 -)))|((( 909 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy aux tunnel 910 -))) 911 -|((( 912 -FLASH.FEL/XGM.INTENSITY/FL2.HALL 913 -)))|((( 914 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall 915 -))) 916 -|((( 917 -FLASH.FEL/XGM.INTENSITY/FL2.HALL:0 918 -)))|((( 919 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall 920 -))) 921 -|((( 922 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL 923 -)))|((( 924 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel 925 -))) 926 -|((( 927 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:0 928 -)))|((( 929 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel 930 -))) 931 -|((( 932 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042 933 -)))|((( 934 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean phtoton energy 935 -))) 936 -|((( 937 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040 938 -)))|((( 939 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelengt 940 -))) 941 -|((( 942 -FLASH.FEL/ADC.ADQ/OPIS1.CH02 943 -)))|((( 944 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Raw data/CH02 945 -))) 946 -|((( 947 -FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2 948 -)))|((( 949 -/FL2/Electron Diagnostic/Bunch charge/after undulator 950 -))) 951 -|((( 952 -FLASH.DIAG/PBD2.TOROID.ML/3GUN/CHARGE.FLASH2 953 -)))|((( 954 -/FL2/Electron Diagnostic/Bunch charge/at gun 955 -))) 956 -|((( 957 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR1.MOT1/FPOS 958 -)))|((( 959 -/FL2/Beamlines/Tunnel Apertures/position aperture1 horizontal 960 -))) 961 -|((( 962 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR2.MOT1/FPOS 963 -)))|((( 964 -/FL2/Beamlines/Tunnel Apertures/position aperture1 vertical 965 -))) 966 -|((( 967 -FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER 968 -)))|((( 969 -/FL2/Beamlines/FL20/Shutter/channel 0 970 -))) 971 -|((( 972 -FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00 973 -)))|((( 974 -/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD 975 -))) 976 -|((( 977 -FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH00 978 -)))|((( 979 -/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH0/TD 980 -))) 981 -|((( 982 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD 983 -)))|((( 984 -/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS 985 -))) 986 -|((( 987 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/LOCK_STATUS.VALUE.RD 988 -)))|((( 989 -/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO 990 -))) 991 -|((( 992 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD 993 -)))|((( 994 -/FL2/Experiment/Pump probe laser/laser delay readback 995 -))) 996 -|((( 997 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION_SET.WR 998 -)))|((( 999 -/FL2/Experiment/Pump probe laser/laser delay set value 1000 -))) 1001 -|((( 1002 -FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS 1003 -)))|((( 1004 -/FL2/Experiment/Pump probe laser/FL24/attenuator position 1005 -))) 1006 -|((( 1007 -FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/POS 1008 -)))|((( 1009 -/FL2/Experiment/Pump probe laser/FL24/polarization position 1010 -))) 1048 +{{code language="none"}}/FL1/Experiment/Pump probe laser/laser delay readback{{/code}} 1049 +//always saved (PBD2)// 1050 +DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}} 1051 +DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}} 1052 +desc: delay of the Pump probe laser - measured by the read back position of the motor. There is also the set value available ( upto now these values are only updating every 1-2 seconds. There is no fast encoder property as on FLASH1 available) 1053 +units : ps ) 1011 1011 1012 1012 \\ 1013 1013 1057 +{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS{{/code}} 1058 +//always saved (PBD)// 1059 +DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}} 1060 +DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}} 1061 +desc: rms jitter of the fs-Oscillator 1062 +units: fs 1063 + 1014 1014 [[Contents>>doc:||anchor="Contents"]] 1015 1015 1066 +\\ 1067 + 1068 +=== "/uncategorized/" === 1069 + 1070 + If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names 1071 + 1072 +\\ 1073 + 1016 1016 === HDF5 structure revisions === 1017 1017 1018 1018 Starting with Beamblock 4, August 2018, the hierarchy of the HDF group names have been adapted to reflect the new situation at FLASH. FLASH2 is operating for users quite some time now. Therefore, both accelerators appear equally in their respective HDF groups, namely "/FL1" and "/FL2". The root group of proper, by run organised HDF files have an attribute called "version". This version attribute has changed from "0.2.x" to "0.3.x". The changes in detail: ... ... @@ -1132,67 +1132,14 @@ 1132 1132 1133 1133 \\ 1134 1134 1135 -== =Samples how to readHDF5with Matlab===1193 +== HDF5 and DOOCS == 1136 1136 1137 - Thexamples applytoHDFfileswithHDF treeversionbeforevers. 0.3.0.1195 +Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>attach:FLASH1__DaqChannel2HdfNamePbd.xlsx]] HDF5 names and the corresponding DOOCS names 1138 1138 1139 - (% style="color: rgb(0,128,0);" %)%% read inheeeded data p=path; path(p,'D:\mess-daten\DAQ-data\hdf5\Gotthard') % add the actual folder to the path hdf5file='FLASH1_EXP-2016-03-16T1420.h5'; % data with Gotthard and VLS1197 +[[Contents>>doc:||anchor="Contents"]] 1140 1140 1141 -(% style="color: rgb(0,128,0);" %)% h5disp(hdf5file,'/','min') % to get an idea what is in the file % h5info(hdf5file,'/Experiment/Gotthard1/BL.0') % get info about the individual channel 1142 - 1143 -(% style="color: rgb(0,128,0);" %)% read a Number per 10 Hz pulse train: 1144 - 1145 -(% class="code" %) 1146 -((( 1147 -FEL_Wavelength_energy_server=h5read(hdf5file,'/Photon Diagnostic/Wavelength/Calculated by energy/wavelength' ); 1148 -))) 1149 - 1150 -(% style="color: rgb(0,128,0);" %)% read in a 1D array (spectrum) %GMD data GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA'); 1151 - 1152 -(% style="color: rgb(0,128,0);" %)% This reads in all the data . One can also limit the amount of data read to a subset of the data stored in the file. e.g. for image Data (Gotthard) 1153 - 1154 1154 \\ 1155 1155 1156 -(% class="code" %) 1157 -((( 1158 -Start_event= 500 ; % define the first 10 Hz event 1159 - Number_of_events = 20; % how many 10 Hz events to load 1160 -))) 1161 - 1162 -(% style="color: rgb(0,128,0);" %)% read only part of the data: 1163 - 1164 -(% class="code" %) 1165 -((( 1166 -Gotthard_data=h5read(hdf5file,'/Experiment/Gotthard1/BL.0',[2 650 Start_event],[50 85 Number_of_events]); 1167 -))) 1168 - 1169 -(% style="color: rgb(0,128,0);" %)% start stop increment "manual" for 2 D data : [start bunch number in Gotthard data start pixelin spectrum start sample in 10 Hz trains], % [number of bunches in the Gotthard data number of points in the spectrum number of spectra ] 1170 - 1171 -(% class="code" %) 1172 -((( 1173 -VLS_Spectrum=h5read(hdf5file,'/Photon Diagnostic/Wavelength/VLS online spectrometer/PCO.ROI.X',[400 Start_event],[200 Number_of_events] ); 1174 - 1175 -))) 1176 - 1177 -(% style="color: rgb(0,128,0);" %)% start stop increment "manual" for 1D data : [start sample in the spectrum start sample in 10 Hz trains],[number of points in the spectrum number of spectra ] 1178 - 1179 -(% style="color: rgb(0,128,0);" %)%GMD data 1180 - 1181 -(% class="code" %) 1182 -((( 1183 -GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA',[1 Start_event],[40 Number_of_events] ); 1184 -))) 1185 - 1186 -[[Contents>>doc:||anchor="Contents"]] 1187 - 1188 -=== How to read HDF5 with Python via FLASHH5 === 1189 - 1190 -With [[FlashH5>>doc:FLASHUSER.FLASHH5 for easier access of FLASH's HDF5 files]] we provide h5py based examples to access and evaluate FLASH's HDF5 files. 1191 - 1192 1192 \\ 1193 1193 1194 -== HDF5 and DOOCS == 1195 - 1196 -Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>attach:FLASH1__DaqChannel2HdfNamePbd.xlsx]] HDF5 names and the corresponding DOOCS names 1197 - 1198 -[[Contents>>doc:||anchor="Contents"]] 1203 +\\