Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55

From version 9.1
edited by sndueste
on 2019/09/17 16:31
Change comment: There is no comment for this version
To version 36.1
edited by sndueste
on 2020/11/16 10:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,33 +1,16 @@
1 1  == Contents ==
2 2  
3 -\\
4 4  
5 -* [[General information about HDF5>>doc:||anchor="General information about HDF5"]]
6 -* [[FLASH HDF5 structure>>doc:||anchor="FLASH HDF5 structure"]]
7 -* [[Most popular FLASH parameters and their names in HDF5>>doc:||anchor="Most popular FLASH parameters and their names in HDF5"]]
8 -** [[FLASH1>>doc:||anchor="FLASH1"]]
9 -*** [[Beamline info (FLASH1)>>doc:||anchor="Beamline info (FLASH1)"]]
10 -*** [[Photon Diagnostics SASE / Spectrometer (FLASH1)>>doc:||anchor="Photon Diagnostics SASE / Spectrometer (FLASH1)"]]
11 -*** [[Electron Beam properties (FLASH1)>>doc:||anchor="Electron Beam properties (FLASH1)"]]
12 -*** [[Timing information, rep rate etc.(FLASH1)>>doc:||anchor="Timing information, rep rate etc.(FLASH1)"]]
13 -*** [[Pump Probe Laser (FLASH1)>>doc:||anchor="Pump Probe Laser (FLASH1)"]]
14 -*** [[User Data (FLASH1)>>doc:||anchor="User Data (FLASH1)"]]
15 -** [[FLASH2>>doc:||anchor="FLASH2"]]
16 -** [[HDF5 structure revisions>>doc:||anchor="HDF5 structure revisions"]]
17 -* [[Example code showing how to access HDF5 files>>doc:||anchor="Example code showing how to access HDF5 files"]]
18 -** [[Samples how to read HDF5 with Matlab>>doc:||anchor="Samples how to read HDF5 with Matlab"]]
19 -** [[How to read HDF5 with Python via FLASHH5>>doc:||anchor="How to read HDF5 with Python via FLASHH5"]]
20 -* [[HDF5 and DOOCS>>doc:||anchor="HDF5 and DOOCS"]]
21 21  
22 -\\
5 +{{toc/}}
23 23  
24 24  \\
25 25  
26 26  == General information about HDF5 ==
27 27  
28 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://www.hdfgroup.org/HDF5/||shape="rect"]]
11 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
29 29  
30 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://support.hdfgroup.org/products/java/hdfview/index.html||shape="rect"]]
13 +To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
31 31  
32 32  For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module :
33 33  {{code language="none"}}> module load xray{{/code}}
... ... @@ -35,9 +35,9 @@
35 35  
36 36  [[Contents>>doc:||anchor="Contents"]]
37 37  
38 -== FLASH HDF5 structure ==
21 +== The current FLASH HDF5 structure ==
39 39  
40 -The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organised according to train IDs. The general structure is:
23 +The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organized according to train IDs. The general structure is:
41 41  
42 42  * Electron Diagnostic
43 43  * Photon Diagnostics
... ... @@ -44,17 +44,45 @@
44 44  * Beamlines
45 45  * Experiment
46 46  * Timing
47 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg~|~|alt="HDF5_structure.jpg" width="700" height="500"~]~]>>attach:HDF5_structure.jpg]]
30 +[[image:attach:HDF5_structure.jpg||height="400"]]
48 48  
49 -A detailled description of (most) channels can be found in the lower part of the hdf5 viewer:
50 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg~|~|alt="HDF5_structure_desc.jpg" width="341" height="413"~]~]>>attach:HDF5_structure_desc.jpg]]
32 +A detailed description of (most) channels can be found in the lower part of the hdf5 viewer:
33 +[[image:attach:HDF5_structure_desc.jpg||thumbnail="true" height="250"]]
51 51  
52 52  [[Contents>>doc:||anchor="Contents"]]
53 53  
54 54  \\
55 55  
56 -== Most popular FLASH parameters and their names in HDF5 ==
39 +=== HDF5 example files ===
57 57  
41 +Here we have a few HDF5 samples (User data combined with Photon diagnostics data) from a few beamtimes showing the different kind options.
42 +
43 +[[image:attach:image2019-10-21_17-2-50.png||thumbnail="true" width="300"]] [[download HDF5 (Images @ FL2)>>url:https://desycloud.desy.de/index.php/s/nyEgeCWJFC4gao2||shape="rect"]]
44 +
45 +\\
46 +
47 +[[~[~[image:attach:image2019-10-22_10-52-27.png~|~|thumbnail="true" width="300"~]~]download HDF5 (GHz ADC and OPIS @ FL2)>>url:https://desycloud.desy.de/index.php/s/AeA2kPNNnZgX95A||shape="rect"]]
48 +
49 +\\
50 +
51 +\\
52 +
53 +[[Contents>>doc:||anchor="Contents"]]
54 +
55 +\\
56 +
57 +== The new (starting 2021) HDF5 format ==
58 +
59 +Here is [[some documentation on the changes of the HDF5 format>>doc:FLASHUSER.The new (starting 2021) HDF5 format]] that well be available in 2021 (work in progress)
60 +
61 +\\
62 +
63 +\\
64 +
65 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
66 +
67 +{{id name="DOOCSparameters"/}}
68 +
58 58  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
59 59  The most common and often used ones are summarized below:
60 60  
... ... @@ -96,7 +96,7 @@
96 96  //always saved (PBD)//
97 97  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
98 98  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
99 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
110 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
100 100  units: degree
101 101  \\
102 102  
... ... @@ -104,7 +104,7 @@
104 104  //always saved (PBD)//
105 105  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
106 106  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
107 -desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
118 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
108 108  units: degree
109 109  \\
110 110  
... ... @@ -134,27 +134,34 @@
134 134  \\
135 135  
136 136  
137 -NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact
148 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. For more Info contact your local contact
138 138  
139 139  [[Contents>>doc:||anchor="Contents"]]
140 140  
141 141  \\
142 142  
143 -==== Photon Diagnostics SASE / Spectrometer (FLASH1) ====
154 +==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) / Spectrometer (FLASH1) ====
144 144  
145 145  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
146 146  //always saved (PBD)//
147 -DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}}
148 -DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}
149 -desc : calibrated average SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current)
158 +(% style="color: rgb(165,173,186);" %)New MTCA Version: DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
159 +(% style="color: rgb(165,173,186);" %)New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
160 +
161 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} (%%)
162 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}(%%)
163 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator (ion current)
150 150  units : microJ
151 151  
152 152  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
153 -//always saved (PBD)//
167 +//always saved (PBD)//
168 +
169 +(% style="color: rgb(193,199,208);" %)New MTCA Version: DOOCS prop : 
170 +{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
171 +
154 154  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
155 155  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
156 156  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
157 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
175 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
158 158  
159 159  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}}
160 160  //always saved (PBD)//
... ... @@ -161,10 +161,14 @@
161 161  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}}
162 162  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}}
163 163  desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
164 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
182 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
165 165  
166 166  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
167 -//always saved (PBD)//
185 +//always saved (PBD)//
186 +
187 +(% style="color: rgb(165,173,186);" %)New MTCA Version: DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.BDA/PHOTONFLUX.UJ{{/code}} (%%)
188 +(% style="color: rgb(165,173,186);" %)New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.BDA/PHOTONFLUX.UJ{{/code}}
189 +
168 168  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT05/VAL{{/code}}
169 169  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENPULSEIC{{/code}}
170 170  desc : calibrated average SASE Energy/pulse measured in the BDA (in the experimental hall) after the attenuator (ion current)
... ... @@ -171,11 +171,14 @@
171 171  units : microJ
172 172  
173 173  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA{{/code}}
174 -//always saved (PBD)//
196 +//always saved (PBD)//
197 +
198 +(% style="color: rgb(193,199,208);" %)New MTCA Version: DOOCS prop : 
199 +{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.BDA/INTENSITY.TD{{/code}}New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.BDA/INTENSITY.TD{{/code}}(%%)
175 175  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
176 176  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
177 177  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
178 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
203 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
179 179  
180 180  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}}
181 181  //always saved (PBD)//
... ... @@ -182,13 +182,15 @@
182 182  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}}
183 183  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
184 184  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
185 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
210 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
186 186  
212 +\\
213 +
187 187  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
188 188  //always saved (PBD)//
189 189  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
190 190  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
191 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, x=horizontal)
218 +desc :Beam position of the photon Beam determined by the GMD (BDA, x=horizontal)
192 192  units : mm
193 193  
194 194  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}}
... ... @@ -195,7 +195,7 @@
195 195  //always saved (PBD)//
196 196  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
197 197  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
198 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, y=vertical)
225 +desc :Beam position of the photon Beam determined by the GMD (BDA, y=vertical)
199 199  units : mm
200 200  
201 201  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}}
... ... @@ -202,7 +202,7 @@
202 202  //always saved (PBD)//
203 203  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
204 204  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
205 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, x=horizontal)
232 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, x=horizontal)
206 206  units : mm
207 207  
208 208  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}}
... ... @@ -209,7 +209,7 @@
209 209  //always saved (PBD)//
210 210  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
211 211  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
212 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, y=vertical)
239 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical)
213 213  units : mm
214 214  
215 215  {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}}
... ... @@ -295,10 +295,25 @@
295 295  //always saved (PBD)//
296 296  DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
297 297  DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
298 -desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
299 -units: ps (bigger numbers indicate later arrivaltime of the electrons)
300 -note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
325 +desc: Electron bunch arrival time measured with the BAM inside the accelerator - however shows a very good correlation to the arrivaltime  of the XUV pulses in the experiment (pulse resolved data).
326 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
301 301  
328 +{{code language="none"}}/FL1/Electron Diagnostic/BAM/1SFELC/electron bunch arrival time (low charge){{/code}}
329 +//always saved (PBD)//
330 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/1SFELC/LOW_CHARGE_ARRIVAL_TIME{{/code}}
331 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/1SFELC.LOW_CHARGE_ARRIVAL_TIME{{/code}}
332 +desc: Electron bunch arrival time measured with the BAM  before the undulator (pulse resolved data). This one was newly installed in 2020.
333 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
334 +
335 +{{info title="BAM hints"}}
336 +* besides the arrivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved.In case of doubt ask your local contact
337 +* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]]
338 +* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]]
339 +* a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
340 +{{/info}}
341 +
342 +\\
343 +
302 302  ===== electron beam profile =====
303 303  
304 304  {{code language="none"}}/FL1/Electron Diagnostic/Electron bunch profile/TDS profile{{/code}}
... ... @@ -402,7 +402,7 @@
402 402  //always saved (PBD)//
403 403  DOOCS prop : {{code language="none"}}none{{/code}}
404 404  DAQ channel: {{code language="none"}}none{{/code}}
405 -desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
447 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 data set the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
406 406  units:
407 407  \\
408 408  
... ... @@ -409,7 +409,7 @@
409 409  ===== Train time =====
410 410  
411 411  {{code language="none"}}/Timing/train time{{/code}}
412 -desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
454 +desc:Local time as array of day, hour, minute, second, and centisecond. This data set is meant for visualization purposes only. For correlations use the train ID or the Unix time of the time stamp
413 413  units: d h min s cs
414 414  \\
415 415  
... ... @@ -475,9 +475,15 @@
475 475  
476 476  ==== User Data (FLASH1) ====
477 477  
520 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
521 +
522 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
523 +
524 +The most common and permanently installed device used by experiment are our ADCs:
525 +
478 478  ===== GHz ADCs =====
479 479  
480 -ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]
528 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
481 481  //saved on DEMAND in the user DAQ//
482 482  \\The HDF5 names for the ADC traces are depending on the beamline :
483 483  \\PG Beamline:
... ... @@ -500,14 +500,12 @@
500 500  here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
501 501  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}}
502 502  
503 -in addition there are also additional parameters saved like:
551 +In addition there are also additional parameters saved like:
504 504  
505 -* sample frequency (in MHz)
506 -* error (state)
507 -* offset
553 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
554 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
555 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
508 508  
509 -~|
510 -
511 511  ===== MHz ADCs =====
512 512  
513 513  similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
... ... @@ -515,10 +515,19 @@
515 515  DOOCS prop : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02/CH00.TD
516 516  DAQ channel: : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02
517 517  
518 -\\
564 +In addition there are also additional parameters saved like:
519 519  
566 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
567 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
568 +
520 520  [[Contents>>doc:||anchor="Contents"]]
521 521  
571 +\\
572 +
573 +\\
574 +
575 +\\
576 +
522 522  === FLASH2 ===
523 523  
524 524  There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
... ... @@ -526,11 +526,11 @@
526 526  ==== Beamline info (FLASH2) ====
527 527  
528 528  (% style="color: rgb(255,153,0);" %)(not yet available){{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}(%%)
529 -//always saved (PBD2)//
530 -DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}}
531 -DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}}
532 -desc: set pressure in the gas attenuator
533 -units: mbar
584 +(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%)
585 +(% style="color: rgb(193,199,208);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
586 +(% style="color: rgb(193,199,208);" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
587 +(% style="color: rgb(193,199,208);" %)desc: set pressure in the gas attenuator (%%)
588 +(% style="color: rgb(193,199,208);" %)units: mbar(%%)
534 534  \\
535 535  
536 536  {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
... ... @@ -545,13 +545,13 @@
545 545  //always saved (PBD2)//
546 546  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
547 547  DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
548 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
603 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
549 549  units: degree
550 550  \\
551 551  
552 552  
553 553  //always saved (PBD2)//
554 -\\\\[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
609 +\\\\**[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
555 555  {{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2 DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}}
556 556  
557 557  \\
... ... @@ -564,7 +564,7 @@
564 564  
565 565  \\
566 566  
567 -==== Photon Diagnostics SASE (XGMD) ====
622 +==== Photon Diagnostics SASE ([[XGMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]] - FLASH2) ====
568 568  
569 569  {{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
570 570  //always saved (PBD2)//
... ... @@ -593,7 +593,7 @@
593 593  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
594 594  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
595 595  desc : Energy per pulse measured in the Tunnel  (in fromt of the gas attenuator and the apertures in the Hall)
596 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
651 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
597 597  
598 598  \\
599 599  
... ... @@ -621,27 +621,21 @@
621 621  //always saved (PBD2)//
622 622  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
623 623  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
624 -desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (tunnel, x=horizontal)
679 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
625 625  units : mm
626 626  
627 627  \\
628 628  
629 -\\
630 -
631 -\\
632 -
633 633  {{code language="none"}}/FL2/Photon Diagnostic/GMD/Average Beam position/position tunnel vertical{{/code}}
634 634  //always saved (PBD2)//
635 635  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
636 636  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
637 -desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (tunnel, x=horizontal)
688 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
638 638  units : mm
639 639  
640 640  \\
641 641  
642 -\\
643 643  
644 -
645 645  //always saved (PBD2)//
646 646  \\\\{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TDDAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 desc: {{/code}}Besides the well calibrated averaged beam position information there is also the option
647 647  {{code language="none"}}to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...)units : mm    {{/code}}
... ... @@ -654,217 +654,281 @@
654 654  
655 655  \\
656 656  
706 +==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
707 +
708 +for more info see:** [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]**
709 +
710 +(The OPIS hall is not installed yet ...)
711 +
657 657  \\
658 658  
714 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean photon energy{{/code}}
715 +// saved opon request (PBD2)//
716 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042{{/code}}
717 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042{{/code}}
718 +desc : mean photon energy ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
719 +units : eV
720 +
659 659  \\
660 660  
723 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelength{{/code}}
724 +// saved opon request (PBD2)//
725 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
726 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
727 +desc : meanwavelength ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
728 +units : nm
729 +
661 661  \\
662 662  
732 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/number of analyzed bunch        (in older version this can be found in OPIS tunnel/Expert stuff/General operation parameters/){{/code}}
733 +// saved opon request (PBD2)//
734 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL060{{/code}}
735 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL060{{/code}}
736 +desc : The bunch number of the bunch used for the wavelength calculation
737 +units :
738 +
663 663  \\
664 664  
741 +If Opis is running typically on the the averaged data is saved. For several experiments it may make sense to save the information for each single bunch. This is up to now done by savng the compleate ADC trace of the TOF setup. This is a huge amount of data and needs processing. This has to be performed after the beamtime in close contact to [[Markus Braune>>mailto:markus.braune@desy.de||shape="rect"]] ( respobsible for [[OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]])
742 +
665 665  \\
666 666  
745 +In case OPIS was not operating there is still informaton about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
746 +
667 667  \\
668 668  
669 669  \\
670 670  
751 +==== Electron Beam properties (FLASH2) ====
752 +
753 +===== bunch charge =====
754 +
755 +{{code language="none"}}/FL2/Electron Diagnostic/Bunch charge/after undulator{{/code}}
756 +//always saved (PBD2)//
757 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
758 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
759 +desc: electron bunch charge FLASH2 (average value for each bunchtrain).
760 +units: nC
761 +
671 671  \\
672 672  
764 +===== undulator settings =====
765 +
766 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
767 +//always saved (PBD2)//
768 +DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
769 +DAQ channel:  {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
770 +desc: Set value for the anticipated wavelength . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ...
771 +units: nm
772 +
773 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE14 gap{{/code}}
774 +//always saved (PBD2)//
775 +DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
776 +DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
777 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
778 +units: mm
779 +
780 +The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
781 +
782 +=====
783 +arrival time =====
784 +
785 +{{code language="none"}}/FL2/Electron Diagnostic/BAM/8FL2XTDS/electron bunch arrival time (low charge){{/code}}
786 +//always saved (PBD2)//
787 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/8FL2XTDS/LOW_CHARGE_ARRIVAL_TIME{{/code}}
788 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/8FL2XTDS.LOW_CHARGE_ARRIVAL_TIME{{/code}}
789 +desc: Electron bunch arrival time measured with the BAM after the FLASH2 undulator (pulse resolved data)
790 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
791 +
792 +**FL1**{{code language="none"}}//Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}}
793 +//always saved (PBD2)//
794 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
795 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
796 +desc: Electron bunch arrival time measured with the BAM  in the accelerator  (pulse resolved data)
797 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
798 +
673 673  \\
674 674  
801 +{{info title="BAM hints"}}
802 +* The BAM 4DBC3 measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !).
803 +* The BAM 8FL2XTDS measures only for FLASH2 BUT has the same data structure as the other BAMS ... thus there are also (random) values in in the  FLASH1 time slot 
804 +** Structure: The first values are for FLASH1 bunches. After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ... .In case of doubt ask your local contact
805 +* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]]
806 +* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]]
807 +* a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
808 +{{/info}}
809 +
810 +
811 +[[Contents>>doc:||anchor="Contents"]]
812 +
675 675  \\
676 676  
677 -(% class="wrapped" %)
678 -|=(((
679 -DAQ name
680 -)))|=(((
681 -HDF5 name
682 -)))
683 -|(((
684 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP
685 -)))|(((
686 -/FL2/Electron Diagnostic/Undulator setting/SASE03 gap
687 -)))
688 -|(((
689 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP
690 -)))|(((
691 -/FL2/Electron Diagnostic/Undulator setting/SASE14 gap
692 -)))
693 -|(((
694 -TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH
695 -)))|(((
696 -/FL2/Electron Diagnostic/Undulator setting/set wavelength
697 -)))
698 -|(((
699 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX.UJ
700 -)))|(((
701 -/FL2/Photon Diagnostic/GMD/Average energy/hall
702 -)))
703 -|(((
704 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX
705 -)))|(((
706 -/FL2/Photon Diagnostic/GMD/Average energy/hall (raw)
707 -)))
708 -|(((
709 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ
710 -)))|(((
711 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel
712 -)))
713 -|(((
714 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX
715 -)))|(((
716 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel (raw)
717 -)))
718 -|(((
719 -FLASH.FEL/XGM.POSMON/FL2.HALL/IX.POS
720 -)))|(((
721 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall horizontal
722 -)))
723 -|(((
724 -FLASH.FEL/XGM.POSMON/FL2.HALL/IY.POS
725 -)))|(((
726 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall vertical
727 -)))
728 -|(((
729 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS
730 -)))|(((
731 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel horizontal
732 -)))
733 -|(((
734 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS
735 -)))|(((
736 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel vertical
737 -)))
738 -|(((
739 -FLASH.FEL/XGM.BPM/FL2.HALL:0
740 -)))|(((
741 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall horizontal
742 -)))
743 -|(((
744 -FLASH.FEL/XGM.BPM/FL2.HALL:1
745 -)))|(((
746 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall vertical
747 -)))
748 -|(((
749 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:0
750 -)))|(((
751 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel horizontal
752 -)))
753 -|(((
754 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:1
755 -)))|(((
756 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical
757 -)))
758 -|(((
759 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:1
760 -)))|(((
761 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy aux tunnel
762 -)))
763 -|(((
764 -FLASH.FEL/XGM.INTENSITY/FL2.HALL
765 -)))|(((
766 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
767 -)))
768 -|(((
769 -FLASH.FEL/XGM.INTENSITY/FL2.HALL:0
770 -)))|(((
771 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
772 -)))
773 -|(((
774 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL
775 -)))|(((
776 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
777 -)))
778 -|(((
779 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:0
780 -)))|(((
781 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
782 -)))
783 -|(((
784 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042
785 -)))|(((
786 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean phtoton energy
787 -)))
788 -|(((
789 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040
790 -)))|(((
791 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelengt
792 -)))
793 -|(((
794 -FLASH.FEL/ADC.ADQ/OPIS1.CH02
795 -)))|(((
796 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Raw data/CH02
797 -)))
798 -|(((
799 -FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2
800 -)))|(((
801 -/FL2/Electron Diagnostic/Bunch charge/after undulator
802 -)))
803 -|(((
804 -FLASH.DIAG/PBD2.TOROID.ML/3GUN/CHARGE.FLASH2
805 -)))|(((
806 -/FL2/Electron Diagnostic/Bunch charge/at gun
807 -)))
808 -|(((
809 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR1.MOT1/FPOS
810 -)))|(((
811 -/FL2/Beamlines/Tunnel Apertures/position aperture1 horizontal
812 -)))
813 -|(((
814 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR2.MOT1/FPOS
815 -)))|(((
816 -/FL2/Beamlines/Tunnel Apertures/position aperture1 vertical
817 -)))
818 -|(((
819 -FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER
820 -)))|(((
821 -/FL2/Beamlines/FL20/Shutter/channel 0
822 -)))
823 -|(((
824 -FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00
825 -)))|(((
826 -/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD
827 -)))
828 -|(((
829 -FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH00
830 -)))|(((
831 -/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH0/TD
832 -)))
833 -|(((
834 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD
835 -)))|(((
836 -/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS
837 -)))
838 -|(((
839 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/LOCK_STATUS.VALUE.RD
840 -)))|(((
841 -/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO
842 -)))
843 -|(((
844 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD
845 -)))|(((
846 -/FL2/Experiment/Pump probe laser/laser delay readback
847 -)))
848 -|(((
849 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION_SET.WR
850 -)))|(((
851 -/FL2/Experiment/Pump probe laser/laser delay set value
852 -)))
853 -|(((
854 -FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS
855 -)))|(((
856 -/FL2/Experiment/Pump probe laser/FL24/attenuator position
857 -)))
858 -|(((
859 -FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/POS
860 -)))|(((
861 -/FL2/Experiment/Pump probe laser/FL24/polarization position
862 -)))
815 +==== Timing information, rep rate etc.  (FLASH2) ====
863 863  
817 +===== start time of FLASH2 =====
818 +
819 +{{code language="none"}}/FL2/Timing/start time flash2{{/code}}
820 +//always saved (PBD2)//
821 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
822 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
823 +desc: The max 600 µs acceleration time of FLASH is devided between FLASH1 and FLASH2. This 600 µs window starts with FLASH1 (up to now)  at a time"label" of 700 µs (for historic reasons). Thus the first bunch of FLASH 1 comes at "700" and the last possibel bunch comes at 1300 (700+600). After FLASH1 train is over ther is a about 70µs switching time with no bunches. Then comes the first FLASH2 bunch.  Thus if e.g. the start time of FLASH2 is 1200 it means that FLASH2 starts at column 500 (1200-700)  in the HDF5 files. (However for yet unknown reasons this may change by 2-3 colums ...)
824 +units: µs
825 +
826 +===== bunch repetition rate =====
827 +
828 +{{code language="none"}}/FL2/Timing/repetition rate{{/code}}
829 +//always saved (PBD2)//
830 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
831 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
832 +desc: repetition rate of the bunches / pulses within the burst (FLASH2)
833 +units: kHz
834 +
835 +===== actual number of pulses =====
836 +
837 +{{code language="none"}}/FL1/Timing/actual number of bunches{{/code}}
838 +//always saved (PBD2)//
839 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
840 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
841 +desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH2)
842 +units:
864 864  \\
865 865  
845 +===== actual pulse pattern recorded after the undulator =====
846 +
847 +{{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}}
848 +//always saved (PBD2)//
849 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
850 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
851 +desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH2)
852 +units:
853 +\\
854 +
855 +===== Train ID =====
856 +
857 +{{code language="none"}}/Timing/train ID{{/code}}
858 +//always saved (PBD2)//
859 +DOOCS prop : {{code language="none"}}none{{/code}}
860 +DAQ channel: {{code language="none"}}none{{/code}}
861 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
862 +units:
863 +\\
864 +
865 +===== Train time =====
866 +
867 +//always saved (PBD2)
868 +//{{code language="none"}}/Timing/train time{{/code}}
869 +desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
870 +units: d h min s cs
871 +\\
872 +
873 +{{code language="none"}}/Timing/time stamp{{/code}}
874 +
875 +//always saved (PBD2)//
876 +desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
877 +second column: microseconds
878 +third column: Train ID of FLASH
879 +\\
880 +
866 866  [[Contents>>doc:||anchor="Contents"]]
867 867  
883 +\\
884 +
885 +==== User Data (FLASH2) ====
886 +
887 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
888 +
889 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
890 +
891 +The most common and permanently installed device used by experiment are our ADCs:
892 +
893 +===== GHz ADCs =====
894 +
895 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
896 +//saved on DEMAND in the user DAQ//
897 +\\Up to now there are 4 channels available at FL24
898 +\\\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD{{/code}}
899 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH01/TD{{/code}}
900 +\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH02/TD{{/code}}{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH03/TD{{/code}}
901 +
902 +\\
903 +
904 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
905 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
906 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00{{/code}}
907 +
908 +In addition there are also additional parameters saved like:
909 +
910 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
911 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
912 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
913 +* {{code language="none"}}/CH0-CH3/offset{{/code}}: To use the full dynamic range of the ADC one can shift the base line . This offset is saved here.
914 +
915 +===== MHz ADCs =====
916 +
917 +similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
918 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH2/TD{{/code}}
919 +DOOCS prop : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02/CH00.TD
920 +DAQ channel: : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02
921 +
922 +In addition there are also additional parameters saved like:
923 +
924 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
925 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
926 +
927 +[[Contents>>doc:||anchor="Contents"]]
928 +
929 +\\
930 +
931 +\\
932 +
933 +==== Pump Probe Laser (FLASH2) ====
934 +
935 +There may be more information available from the "Laser DAQ". laese contact your Laser Local Contact.
936 +
937 +
938 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/attenuator position{{/code}}//always saved (PBD2)//
939 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
940 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
941 +desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
942 +units : deg.
943 +
944 +\\
945 +
946 +
947 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/polarization position{{/code}}//always saved (PBD2)//
948 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
949 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
950 +desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
951 +units : deg.
952 +
953 +\\
954 +
955 +{{code language="none"}}/FL1/Experiment/Pump probe laser/laser delay readback{{/code}}
956 +//always saved (PBD2)//
957 +DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}}
958 +DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}}
959 +desc: delay of the Pump probe laser - measured by the read back position of the motor. There is also the set value available ( upto now these values are only updating every 1-2 seconds. There is no fast encoder property as on FLASH1 available)
960 +units : ps )
961 +
962 +\\
963 +
964 +{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS{{/code}}
965 +//always saved (PBD)//
966 +DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
967 +DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
968 +desc: rms jitter of the fs-Oscillator
969 +units: fs
970 +
971 +[[Contents>>doc:||anchor="Contents"]]
972 +
973 +\\
974 +
975 +=== "/uncategorized/" ===
976 +
977 + If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names
978 +
979 +\\
980 +
868 868  === HDF5 structure revisions ===
869 869  
870 870  Starting with Beamblock 4, August 2018, the hierarchy of the HDF group names have been adapted to reflect the new situation at FLASH. FLASH2 is operating for users quite some time now. Therefore, both accelerators appear equally in their respective HDF groups, namely "/FL1" and "/FL2". The root group of proper, by run organised HDF files have an attribute called "version". This version attribute has changed from "0.2.x" to "0.3.x". The changes in detail: