Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 5.1
edited by sndueste
on 2019/09/16 10:24
Change comment: There is no comment for this version
To version 56.1
edited by sndueste
on 2022/09/07 09:38
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,71 +1,135 @@
1 +{{layout}}
2 +{{layout-section ac:type="single"}}
3 +{{layout-cell}}
1 1  == Contents ==
2 2  
3 -\\
4 4  
5 -* [[General information about HDF5>>doc:||anchor="General information about HDF5"]]
6 -* [[FLASH HDF5 structure>>doc:||anchor="FLASH HDF5 structure"]]
7 -* [[Most popular FLASH parameters and their names in HDF5>>doc:||anchor="Most popular FLASH parameters and their names in HDF5"]]
8 -** [[FLASH1>>doc:||anchor="FLASH1"]]
9 -*** [[Beamline info (FLASH1)>>doc:||anchor="Beamline info (FLASH1)"]]
10 -*** [[Photon Diagnostics SASE / Spectrometer (FLASH1)>>doc:||anchor="Photon Diagnostics SASE / Spectrometer (FLASH1)"]]
11 -*** [[Electron Beam properties (FLASH1)>>doc:||anchor="Electron Beam properties (FLASH1)"]]
12 -*** [[Timing information, rep rate etc.(FLASH1)>>doc:||anchor="Timing information, rep rate etc.(FLASH1)"]]
13 -*** [[Pump Probe Laser (FLASH1)>>doc:||anchor="Pump Probe Laser (FLASH1)"]]
14 -*** [[User Data (FLASH1)>>doc:||anchor="User Data (FLASH1)"]]
15 -** [[FLASH2>>doc:||anchor="FLASH2"]]
16 -** [[HDF5 structure revisions>>doc:||anchor="HDF5 structure revisions"]]
17 -* [[Example code showing how to access HDF5 files>>doc:||anchor="Example code showing how to access HDF5 files"]]
18 -** [[Samples how to read HDF5 with Matlab>>doc:||anchor="Samples how to read HDF5 with Matlab"]]
19 -** [[How to read HDF5 with Python via FLASHH5>>doc:||anchor="How to read HDF5 with Python via FLASHH5"]]
20 -* [[HDF5 and DOOCS>>doc:||anchor="HDF5 and DOOCS"]]
21 21  
22 -\\
8 +{{toc/}}
23 23  
24 24  \\
25 25  
26 26  == General information about HDF5 ==
27 27  
28 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://www.hdfgroup.org/HDF5/||shape="rect"]]
14 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
29 29  
30 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://support.hdfgroup.org/products/java/hdfview/index.html||shape="rect"]]
16 +To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
31 31  
32 32  For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module :
33 33  {{code language="none"}}> module load xray{{/code}}
34 34  {{code language="none"}}> hdfview{{/code}}
35 35  
22 +or you can use
23 +
24 +{{code language="none"}}> silx view{{/code}}
25 +
26 +\\
27 +
36 36  [[Contents>>doc:||anchor="Contents"]]
37 37  
38 -== FLASH HDF5 structure ==
30 +== The FLASH HDF5 format ==
39 39  
40 -The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organised according to train IDs. The general structure is:
32 +FLASH provides a conversion of its data acquisition (DAQ) to the commonly used [[HDF5>>url:https://www.hdfgroup.org/solutions/hdf5/||shape="rect"]] format. Correlated  data are mapped by a primary index called **train ID**. Every data set has an individual index of train IDs to identify the data even when data are missing or deviate in update rate. If the data set of choice contains gaps,  users have to decide how to treat missing values. DAQ channels are spread across various files with one file name pattern for each DAQ. This means users have to assemble data from different files if necessary.
41 41  
42 -* Electron Diagnostic
43 -* Photon Diagnostics
44 -* Beamlines
45 -* Experiment
46 -* Timing
47 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg~|~|alt="HDF5_structure.jpg" width="700" height="500"~]~]>>attach:HDF5_structure.jpg]]
34 +The hierarchy is realized using a human readable named HDF tree with each DAQ channel containing the data sets "//value//" and "//index//". Additionally, the HDF group //zraw// contains a tree of the original DAQ channel names.
48 48  
49 -A detailled description of (most) channels can be found in the lower part of the hdf5 viewer:
50 -[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg~|~|alt="HDF5_structure_desc.jpg" width="341" height="413"~]~]>>attach:HDF5_structure_desc.jpg]]
36 +Reference implementation, which follows the concept of Python libraries like Pandas, Xarray, or Dask, is given below.
51 51  
52 -[[Contents>>doc:||anchor="Contents"]]
38 +\\
53 53  
40 +{{expand title="Discontinued HDF formats"}}
41 +=== Comparison to FLASH's deprecated HDF formats ===
42 +
43 +Before 2021, FLASH provided two different HDF formats formally known as //near-online// and //offline// HDF files.
44 +
45 +All data sets were aligned by the same global index by filling in missing data. Fast DAQ channels  (pulse synchronous data - update 10 Hz) are filled in by NaN or 0, slow channels (not pulse synchronous data - update e.g. 1 Hz ) are interpolated by the DAQs libraries, by keeping the value constant up to the next change.
46 +
47 +While the near-online HDF files were converted live during the beamtime, the offline HDF files were manually compiled weeks/months later. Near-online HDF files were used by a provided API [[BeamtimeDaqAccess>>url:https://confluence.desy.de/display/FLASHUSER/Near-Online+data+analysis#Near-Onlinedataanalysis-BriefUserGuidetoBeamtimeDAQAccess||shape="rect"]], which also searches for DAQ channels in files. With assembled files "by run", all DAQ channels were existing in the same HDF file. While shorter runs usually fitted into one file, longer runs still had to be aggregated over several files. The creation of the assembled type of files still involves the use of fairly unstable DAQ Mex-functions As the environment required for using the Mex-functions is already deprecated, its continued existence is uncertain.
48 +
49 +The HDF hierarchy is almost identical in all formats. While in the the recent format each DAQ channel contains the data sets "value" and "index", the deprecated format had one data set for each DAQ channel. The deprecated formats supplies no time axis parameters for spectra data types.
50 +
54 54  \\
55 55  
56 -== Most popular FLASH parameters and their names in HDF5 ==
53 +**HDF5 example files (old format)**
57 57  
58 -The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
59 -The most common and often used ones are summarized below:
55 +Here we have a few HDF5 samples (User data combined with Photon diagnostics data) from a few beamtimes showing the different kind options.
60 60  
61 -Note, the HDF group and data set names apply to our HDF tree version since vers. 0.3.0.
57 +[[image:attach:image2019-10-21_17-2-50.png||thumbnail="true" width="300"]] [[download HDF5 (Images @ FL2)>>url:https://desycloud.desy.de/index.php/s/nyEgeCWJFC4gao2||shape="rect"]]
62 62  
63 63  \\
64 64  
65 -=== FLASH1 ===
61 +[[~[~[image:attach:image2019-10-22_10-52-27.png~|~|thumbnail="true" width="300"~]~]download HDF5 (GHz ADC and OPIS @ FL2)>>url:https://desycloud.desy.de/index.php/s/AeA2kPNNnZgX95A||shape="rect"]]
66 66  
67 67  \\
68 68  
65 +\\
66 +{{/expand}}
67 +
68 +=== HDF examples: ===
69 +{{/layout-cell}}
70 +{{/layout-section}}
71 +
72 +{{layout-section ac:type="three_equal"}}
73 +{{layout-cell}}
74 +* ADC data as example for **fast** **data** (10 Hz):           
75 +
76 +\\
77 +
78 +[[image:attach:image2020-11-16_15-26-28.png||height="250"]]
79 +{{/layout-cell}}
80 +
81 +{{layout-cell}}
82 +* The //average// FEL pulse energy as example for the **slow** **data** (different e.g. 1 Hz):
83 +
84 + ( every 10th train ID is listed in the HDF group "index")
85 +
86 +\\
87 +
88 +[[image:attach:image2020-11-16_15-31-45.png||height="250"]]
89 +{{/layout-cell}}
90 +
91 +{{layout-cell}}
92 +* (((
93 +//zraw// group contains the **original DAQ (DOOCS) names**
94 +)))
95 +
96 + of the properties saved in the DESY internal raw format. (For experts)
97 +
98 +\\
99 +
100 +[[image:attach:image2020-11-16_16-26-3.png||height="400"]]
101 +{{/layout-cell}}
102 +{{/layout-section}}
103 +
104 +{{layout-section ac:type="single"}}
105 +{{layout-cell}}
106 +{{info}}
107 +=== Reference implementation (Python) ===
108 +
109 +(imperative)  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
110 +
111 +(% class="Object" %)(object oriented) [[https:~~/~~/gitlab.desy.de/christopher.passow/fdh-builder>>url:https://gitlab.desy.de/christopher.passow/fdh-builder.git||shape="rect"]]
112 +{{/info}}
113 +{{/layout-cell}}
114 +{{/layout-section}}
115 +
116 +{{layout-section ac:type="single"}}
117 +{{layout-cell}}
118 +== Complete list of recordable parameters ==
119 +
120 +The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
121 +\\
122 +
123 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
124 +
125 +{{id name="DOOCSparameters"/}}
126 +
127 +Note, the HDF group and data set names apply to our HDF tree version since vers. 0.3.0.
128 +
129 +\\
130 +
131 +=== FLASH1 ===
132 +
69 69  ==== Beamline info (FLASH1) ====
70 70  
71 71  {{code language="none"}}/FL1/Beamlines/Attenuator/pressure{{/code}}
... ... @@ -96,7 +96,7 @@
96 96  //always saved (PBD)//
97 97  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
98 98  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
99 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
163 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
100 100  units: degree
101 101  \\
102 102  
... ... @@ -104,7 +104,7 @@
104 104  //always saved (PBD)//
105 105  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
106 106  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
107 -desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
171 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
108 108  units: degree
109 109  \\
110 110  
... ... @@ -130,25 +130,36 @@
130 130  DAQ channel: {{code language="none"}}TTF2.FEL/PGFILTERS/PGFILTERS/FW.MOTOR.POS{{/code}}
131 131  desc: Position of the PG filter wheel 3
132 132  units: degree
197 +
133 133  \\
134 134  
200 +
201 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. For more Info contact your local contact
202 +
135 135  [[Contents>>doc:||anchor="Contents"]]
136 136  
137 -==== Photon Diagnostics SASE / Spectrometer (FLASH1) ====
205 +\\
138 138  
207 +==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) ====
208 +
209 +{{expand title="Discontinued GMD format (used until 2021)"}}
210 +(% style="color: rgb(0,0,0);" %)**Discontinued GMD data recording / evaluation  (VME + PhotonFlux ML server)**
211 +
139 139  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
140 -//always saved (PBD)//
141 -DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}}
142 -DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}
143 -desc : calibrated average SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current)
213 +//always saved (PBD)//
214 +
215 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} (%%)
216 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}(%%)
217 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator (ion current)
144 144  units : microJ
145 145  
146 146  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
147 -//always saved (PBD)//
221 +//always saved (PBD)//
222 +
148 148  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
149 149  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
150 150  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
151 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
226 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
152 152  
153 153  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}}
154 154  //always saved (PBD)//
... ... @@ -155,10 +155,11 @@
155 155  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}}
156 156  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}}
157 157  desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
158 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
233 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
159 159  
160 160  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
161 -//always saved (PBD)//
236 +//always saved (PBD)//
237 +
162 162  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT05/VAL{{/code}}
163 163  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENPULSEIC{{/code}}
164 164  desc : calibrated average SASE Energy/pulse measured in the BDA (in the experimental hall) after the attenuator (ion current)
... ... @@ -165,11 +165,12 @@
165 165  units : microJ
166 166  
167 167  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA{{/code}}
168 -//always saved (PBD)//
244 +//always saved (PBD)//
245 +
169 169  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
170 170  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
171 171  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
172 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
249 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
173 173  
174 174  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}}
175 175  //always saved (PBD)//
... ... @@ -176,13 +176,65 @@
176 176  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}}
177 177  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
178 178  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
179 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
256 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
257 +{{/expand}}
180 180  
259 +\\
260 +
261 +(% style="letter-spacing: 0px; color: rgb(0, 0, 0)" %)**NEW (since 2021) GMD data recording / evaluation  (same format as FLASH2 and XFEL)**
262 +
263 +{{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
264 +//always saved (PBD)//
265 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
266 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
267 +
268 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator
269 +units : microJ
270 +
271 +\\
272 +
273 +{{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
274 +//always saved (PBD)//
275 +
276 +(% style="color: rgb(0,0,0);" %)DOOCS prop : 
277 +{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
278 +
279 +desc : Energy per pulse measured in the Tunnel.  In addition measurement errors and beam position are included for EACH pulse in the pulse train  !! (see below)
280 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
281 +
282 +{{info title="GMD pulse resolved data structure"}}
283 +For every pulse in the pulse train the information is saved:
284 +
285 +
286 +1. **Intensity per pulse** (a.u. (more or less µJ ))
287 +1. Intensity per pulse (auxillary GMD) - not used
288 +1. Position horizontal (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
289 +1. Position vertical (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
290 +1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%))
291 +1. Position horizontal sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
292 +1. Position vertical sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
293 +1. Combined warning and error flags
294 +
295 +The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 
296 +file
297 +
298 +
299 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]]
300 +
301 +\\
302 +{{/info}}
303 +
304 +All values for the GMD are also available for the** BDA GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between BDA and Tunnel signal shows the attenuation. **BUT NOTE** that the filter units  are downstream the GMD. So if filters  are used this influence is NOT measured by the GMD BDA !
305 +
306 +\\
307 +
308 +Besides  pulse energy the GMD also provides information about the beam position
309 +
181 181  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
182 182  //always saved (PBD)//
183 183  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
184 184  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
185 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, x=horizontal)
314 +desc :Beam position of the photon Beam determined by the GMD (BDA, x=horizontal)
186 186  units : mm
187 187  
188 188  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}}
... ... @@ -189,7 +189,7 @@
189 189  //always saved (PBD)//
190 190  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
191 191  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
192 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, y=vertical)
321 +desc :Beam position of the photon Beam determined by the GMD (BDA, y=vertical)
193 193  units : mm
194 194  
195 195  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}}
... ... @@ -196,7 +196,7 @@
196 196  //always saved (PBD)//
197 197  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
198 198  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
199 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, x=horizontal)
328 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, x=horizontal)
200 200  units : mm
201 201  
202 202  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}}
... ... @@ -203,9 +203,13 @@
203 203  //always saved (PBD)//
204 204  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
205 205  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
206 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, y=vertical)
335 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical)
207 207  units : mm
208 208  
338 +\\
339 +
340 +==== Spectrometer (FLASH1) ====
341 +
209 209  {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}}
210 210  _always saved (when Spectrum is measured !!) (PBD) _
211 211  DOOCS prop : {{code language="none"}}TTF2.EXP/PHOTONWL.ML/WAVE_LENGTH/VAL.TD{{/code}}
... ... @@ -289,10 +289,25 @@
289 289  //always saved (PBD)//
290 290  DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
291 291  DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
292 -desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
293 -units: ps (bigger numbers indicate later arrivaltime of the electrons)
294 -note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://mskwiki/index.php?title=BAM-DAQ_Channels||shape="rect"]]
425 +desc: Electron bunch arrival time measured with the BAM inside the accelerator - however shows a very good correlation to the arrivaltime  of the XUV pulses in the experiment (pulse resolved data).
426 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
295 295  
428 +{{code language="none"}}/FL1/Electron Diagnostic/BAM/1SFELC/electron bunch arrival time (low charge){{/code}}
429 +//always saved (PBD)//
430 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/1SFELC/LOW_CHARGE_ARRIVAL_TIME{{/code}}
431 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/1SFELC.LOW_CHARGE_ARRIVAL_TIME{{/code}}
432 +desc: Electron bunch arrival time measured with the BAM  before the undulator (pulse resolved data). This one was newly installed in 2020.
433 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
434 +
435 +{{info title="BAM hints"}}
436 +* besides the arrivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved.In case of doubt ask your local contact
437 +* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]]
438 +* [[LINK to detailed infos from MSK>>url:https://confluence.desy.de/display/SDiagPublic/BAM+Data+Structure||shape="rect"]]
439 +* a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
440 +{{/info}}
441 +
442 +\\
443 +
296 296  ===== electron beam profile =====
297 297  
298 298  {{code language="none"}}/FL1/Electron Diagnostic/Electron bunch profile/TDS profile{{/code}}
... ... @@ -321,7 +321,7 @@
321 321  ===== electron bunch energy =====
322 322  
323 323  {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/average electron energy{{/code}}
324 -_always saved (PBD)
472 +//always saved (PBD)//
325 325  DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_INTRA_MEAN/VAL{{/code}}
326 326  DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_MEAN{{/code}}
327 327  desc: electron bunch energy (average over the bunch train)
... ... @@ -329,7 +329,7 @@
329 329  \\
330 330  
331 331  {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/pulse resolved energy{{/code}}
332 -_always saved (PBD)
480 +//always saved (PBD)//
333 333  DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_SPECT/VAL.TD{{/code}}
334 334  DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_SPECT{{/code}}
335 335  desc: electron bunch energy bunch resolved
... ... @@ -338,7 +338,7 @@
338 338  \\
339 339  
340 340  {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/wavelength bunch train average{{/code}}
341 -_always saved (PBD)
489 +//always saved (PBD)//
342 342  DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/LAMBDA_MEAN/VAL{{/code}}
343 343  DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/LAMBDA_MEAN{{/code}}
344 344  desc: Wavelength calculated by the electron bunch energy (average over the bunch train) (FLASH1)
... ... @@ -386,7 +386,7 @@
386 386  //always saved (PBD)//
387 387  DOOCS prop : {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP/CHARGE.TD{{/code}}
388 388  DAQ channel: {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP{{/code}}
389 -desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH1)
537 +desc: The bunch pattern as function of time in a burst recorded by toroid diagnostic BEHIND the undulator. (FLASH1)
390 390  units:
391 391  \\
392 392  
... ... @@ -396,7 +396,7 @@
396 396  //always saved (PBD)//
397 397  DOOCS prop : {{code language="none"}}none{{/code}}
398 398  DAQ channel: {{code language="none"}}none{{/code}}
399 -desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
547 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 data set the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
400 400  units:
401 401  \\
402 402  
... ... @@ -403,7 +403,7 @@
403 403  ===== Train time =====
404 404  
405 405  {{code language="none"}}/Timing/train time{{/code}}
406 -desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
554 +desc:Local time as array of day, hour, minute, second, and centisecond. This data set is meant for visualization purposes only. For correlations use the train ID or the Unix time of the time stamp
407 407  units: d h min s cs
408 408  \\
409 409  
... ... @@ -459,7 +459,7 @@
459 459  //always saved (PBD)//
460 460  DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}}
461 461  DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}}
462 -desc: delaytime between the optical laser and the FEL units: ps
610 +desc: delay time between the optical laser and the FEL units: ps
463 463  
464 464  \\
465 465  
... ... @@ -469,9 +469,15 @@
469 469  
470 470  ==== User Data (FLASH1) ====
471 471  
620 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring of slow properties (motor positions etc) for user experiments. For details please ask your local contact.
621 +
622 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
623 +
624 +The most common and permanently installed device used by experiment are our ADCs:
625 +
472 472  ===== GHz ADCs =====
473 473  
474 -ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]
628 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
475 475  //saved on DEMAND in the user DAQ//
476 476  \\The HDF5 names for the ADC traces are depending on the beamline :
477 477  \\PG Beamline:
... ... @@ -491,17 +491,15 @@
491 491  {{code language="none"}}/FL1/Experiment/BL3/ADQ412 GHz ADC/CH03/TD{{/code}}
492 492  
493 493  DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
494 -here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
648 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} contains only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferably.
495 495  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}}
496 496  
497 -in addition there are also additional parameters saved like:
651 +In addition there are also additional parameters saved like:
498 498  
499 -* sample frequency (in MHz)
500 -* error (state)
501 -* offset
653 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
654 +* {{code language="none"}}number of samples{{/code}}: total number of samples recorded for each 10 Hz trigger
655 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
502 502  
503 -~|
504 -
505 505  ===== MHz ADCs =====
506 506  
507 507  similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
... ... @@ -509,211 +509,437 @@
509 509  DOOCS prop : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02/CH00.TD
510 510  DAQ channel: : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02
511 511  
512 -\\
664 +In addition there are also additional parameters saved like:
513 513  
666 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
667 +* {{code language="none"}}number of samples{{/code}}: total number of samples recorded for each 10 Hz trigger
668 +
514 514  [[Contents>>doc:||anchor="Contents"]]
515 515  
671 +\\
672 +
673 +\\
674 +
675 +\\
676 +
516 516  === FLASH2 ===
517 517  
679 +There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
680 +
681 +==== Beamline info (FLASH2) ====
682 +
683 +{{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}
684 +(% style="color: rgb(0,0,0);" %)//always saved (PBD2)// (%%)
685 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
686 +(% style="color: rgb(0,0,0);" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
687 +(% style="color: rgb(0,0,0);" %)desc: set pressure in the gas attenuator (%%)
688 +(% style="color: rgb(0,0,0);" %)units: mbar(%%)
518 518  \\
519 519  
691 +{{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
692 +//always saved (PBD2)//
693 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER/CH00.TD{{/code}}
694 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER{{/code}}
695 +desc: BL Beamline Fast shutter state: 1 is open, 0 is closed ( for technical reasons there are 100 vales of this state saved ...)
696 +units: none
697 +
698 +
699 +{{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 1{{/code}}
700 +//always saved (PBD2)//
701 +DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
702 +DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
703 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
704 +units: degree
520 520  \\
521 521  
707 +/FL2/Beamlines/Filter wheel/position wheel 2
708 +always saved (PBD2)
709 +DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}}
710 +DAQ channel: {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}}
711 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
712 +units: degree
713 +
522 522  \\
523 523  
716 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact
717 +
718 +[[Contents>>doc:||anchor="Contents"]]
719 +
524 524  \\
525 525  
526 -(% class="wrapped" %)
527 -|=(((
528 -DAQ name
529 -)))|=(((
530 -HDF5 name
531 -)))
532 -|(((
533 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP
534 -)))|(((
535 -/FL2/Electron Diagnostic/Undulator setting/SASE03 gap
536 -)))
537 -|(((
538 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP
539 -)))|(((
540 -/FL2/Electron Diagnostic/Undulator setting/SASE14 gap
541 -)))
542 -|(((
543 -TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH
544 -)))|(((
545 -/FL2/Electron Diagnostic/Undulator setting/set wavelength
546 -)))
547 -|(((
548 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX.UJ
549 -)))|(((
550 -/FL2/Photon Diagnostic/GMD/Average energy/hall
551 -)))
552 -|(((
553 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX
554 -)))|(((
555 -/FL2/Photon Diagnostic/GMD/Average energy/hall (raw)
556 -)))
557 -|(((
558 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ
559 -)))|(((
560 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel
561 -)))
562 -|(((
563 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX
564 -)))|(((
565 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel (raw)
566 -)))
567 -|(((
568 -FLASH.FEL/XGM.POSMON/FL2.HALL/IX.POS
569 -)))|(((
570 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall horizontal
571 -)))
572 -|(((
573 -FLASH.FEL/XGM.POSMON/FL2.HALL/IY.POS
574 -)))|(((
575 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall vertical
576 -)))
577 -|(((
578 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS
579 -)))|(((
580 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel horizontal
581 -)))
582 -|(((
583 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS
584 -)))|(((
585 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel vertical
586 -)))
587 -|(((
588 -FLASH.FEL/XGM.BPM/FL2.HALL:0
589 -)))|(((
590 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall horizontal
591 -)))
592 -|(((
593 -FLASH.FEL/XGM.BPM/FL2.HALL:1
594 -)))|(((
595 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall vertical
596 -)))
597 -|(((
598 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:0
599 -)))|(((
600 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel horizontal
601 -)))
602 -|(((
603 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:1
604 -)))|(((
605 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical
606 -)))
607 -|(((
608 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:1
609 -)))|(((
610 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy aux tunnel
611 -)))
612 -|(((
613 -FLASH.FEL/XGM.INTENSITY/FL2.HALL
614 -)))|(((
615 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
616 -)))
617 -|(((
618 -FLASH.FEL/XGM.INTENSITY/FL2.HALL:0
619 -)))|(((
620 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
621 -)))
622 -|(((
623 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL
624 -)))|(((
625 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
626 -)))
627 -|(((
628 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:0
629 -)))|(((
630 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
631 -)))
632 -|(((
633 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042
634 -)))|(((
635 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean phtoton energy
636 -)))
637 -|(((
638 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040
639 -)))|(((
640 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelengt
641 -)))
642 -|(((
643 -FLASH.FEL/ADC.ADQ/OPIS1.CH02
644 -)))|(((
645 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Raw data/CH02
646 -)))
647 -|(((
648 -FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2
649 -)))|(((
650 -/FL2/Electron Diagnostic/Bunch charge/after undulator
651 -)))
652 -|(((
653 -FLASH.DIAG/PBD2.TOROID.ML/3GUN/CHARGE.FLASH2
654 -)))|(((
655 -/FL2/Electron Diagnostic/Bunch charge/at gun
656 -)))
657 -|(((
658 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR1.MOT1/FPOS
659 -)))|(((
660 -/FL2/Beamlines/Tunnel Apertures/position aperture1 horizontal
661 -)))
662 -|(((
663 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR2.MOT1/FPOS
664 -)))|(((
665 -/FL2/Beamlines/Tunnel Apertures/position aperture1 vertical
666 -)))
667 -|(((
668 -FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER
669 -)))|(((
670 -/FL2/Beamlines/FL20/Shutter/channel 0
671 -)))
672 -|(((
673 -FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00
674 -)))|(((
675 -/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD
676 -)))
677 -|(((
678 -FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH00
679 -)))|(((
680 -/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH0/TD
681 -)))
682 -|(((
683 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD
684 -)))|(((
685 -/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS
686 -)))
687 -|(((
688 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/LOCK_STATUS.VALUE.RD
689 -)))|(((
690 -/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO
691 -)))
692 -|(((
693 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD
694 -)))|(((
695 -/FL2/Experiment/Pump probe laser/laser delay readback
696 -)))
697 -|(((
698 -FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION_SET.WR
699 -)))|(((
700 -/FL2/Experiment/Pump probe laser/laser delay set value
701 -)))
702 -|(((
703 -FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS
704 -)))|(((
705 -/FL2/Experiment/Pump probe laser/FL24/attenuator position
706 -)))
707 -|(((
708 -FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/POS
709 -)))|(((
710 -/FL2/Experiment/Pump probe laser/FL24/polarization position
711 -)))
722 +\\
712 712  
724 +==== Photon Diagnostics SASE ([[XGMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]] - FLASH2) ====
725 +
726 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
727 +//always saved (PBD2)//
728 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
729 +DAQ channel:{{code language="none"}} FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
730 +desc : calibrated average ( ~~ 20 sec averaging time ) SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current)
731 +units : microJ
732 +
713 713  \\
714 714  
735 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
736 +//always saved (PBD2)//
737 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
738 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
739 +desc : Energy per pulse measured in the Tunnel  (in front of the gas attenuator and the apertures in the Hall) In addition measurement errors and beam position are included for EACH pulse in the pulse train  !! (see below)
740 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
741 +
742 +{{info title="GMD pulse resolved data structure"}}
743 +For every pulse in the pulse train the information is saved:
744 +
745 +
746 +1. **Intensity per pulse** (a.u. (more or less µJ ))
747 +1. Intensity per pulse (auxillary GMD) - not used
748 +1. Position horizontal (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
749 +1. Position vertical (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
750 +1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%))
751 +1. Position horizontal sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
752 +1. Position vertical sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
753 +1. Combined warning and error flags
754 +
755 +The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 
756 +file
757 +
758 +
759 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]]
760 +
761 +\\
762 +{{/info}}
763 +
764 +\\
765 +
766 +All values for the GMD are also available for the** HALL GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between Hall and Tunnel signal shows the attenuation. **BUT NOTE** that the filter unit and the Aperture 4 are downstream the GMD. So if filters and aperture are used this influence is NOT measured by the GMD hall !
767 +
768 +\\
769 +
770 +Besides  pulse energy the GMD also provides information about the beam position
771 +
772 +\\
773 +
774 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Average Beam position/position tunnel horizontal{{/code}}
775 +//always saved (PBD2)//
776 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
777 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
778 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
779 +units : mm
780 +
781 +\\
782 +
783 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Average Beam position/position tunnel vertical{{/code}}
784 +//always saved (PBD2)//
785 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
786 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
787 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
788 +units : mm
789 +
790 +\\
791 +
792 +/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x
793 +always saved (PBD2)
794 +DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TD
795 +DAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2
796 +desc: Besides the well calibrated averaged beam position information there is also the option to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...)
797 +units : mm   
798 +
799 +(x=horizontal, y = vertial)
800 +
801 +again the same parameter set is available for the **HALL GMD**
802 +
803 +\\
804 +
805 +\\
806 +
807 +==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
808 +
809 +for more info see:** [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]**
810 +
811 +(The OPIS hall is not installed yet ...)
812 +
813 +\\
814 +
815 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean photon energy{{/code}}
816 +// saved opon request (PBD2)//
817 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042{{/code}}
818 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042{{/code}}
819 +desc : mean photon energy ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
820 +units : eV
821 +
822 +\\
823 +
824 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelength{{/code}}
825 +// saved opon request (PBD2)//
826 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
827 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
828 +desc : mean wavelength ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
829 +units : nm
830 +
831 +\\
832 +
833 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/number of analyzed bunch        (in older version this can be found in OPIS tunnel/Expert stuff/General operation parameters/){{/code}}
834 +// saved opon request (PBD2)//
835 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL060{{/code}}
836 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL060{{/code}}
837 +desc : The bunch number of the bunch used for the wavelength calculation
838 +units :
839 +
840 +\\
841 +
842 +If Opis is running typically on the the averaged data is saved. For several experiments it may make sense to save the information for each single bunch. This is up to now done by saving the complete ADC trace of the TOF setup. This is a huge amount of data and needs processing. This has to be performed after the beamtime in close contact to [[Markus Braune>>mailto:markus.braune@desy.de||shape="rect"]] ( responsible for [[OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]])
843 +
844 +\\
845 +
846 +In case OPIS was not operating there is still information about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
847 +
848 +\\
849 +
850 +\\
851 +
852 +==== Electron Beam properties (FLASH2) ====
853 +
854 +===== bunch charge =====
855 +
856 +{{code language="none"}}/FL2/Electron Diagnostic/Bunch charge/after undulator{{/code}}
857 +//always saved (PBD2)//
858 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
859 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
860 +desc: electron bunch charge FLASH2 (average value for each bunchtrain).
861 +units: nC
862 +
863 +\\
864 +
865 +===== electron bunch energy =====
866 +
867 +{{code language="none"}}/FL2/Electron Diagnostic/Electron energy/energy of first bunch/behind undulators{{/code}}
868 +//always saved (PBD2)//
869 +DOOCS prop : {{code language="none"}}FLASH.DIAG/BEAM_ENERGY_MEASUREMENT/FL2XTDS/ENERGY.FLASH2{{/code}}
870 +DAQ channel: (% style="color: rgb(94,108,132);" %)TTF2.DAQ/PBD2.BEAM.ENERGY.MEAS.ML.COPY/FL2XTDS.ENERGY.FLASH2{{code language="none"}}{{/code}}(%%)
871 +desc: electron bunch energy measured behind the undulator. Data is saved with 10 Hz - BUT (for computation reasons) only the energy of the FIRST bunch is recorded. The data is also available for (% style="color: rgb(94,108,132);" %)extraction and septum  in the beginning of FLASH2
872 +
873 +(% style="letter-spacing: 0.0px;" %)units: (% class="twikiNewLink" %)MeV
874 +
875 +\\
876 +
877 +(% style="color: rgb(94,108,132);font-weight: 600;letter-spacing: 0.0px;" %)
878 +undulator settings
879 +
880 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
881 +//always saved (PBD2)//
882 +DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
883 +DAQ channel:  {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
884 +desc: Set value for the anticipated wavelength . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ...
885 +units: nm
886 +
887 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE14 gap{{/code}}
888 +//always saved (PBD2)//
889 +DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
890 +DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
891 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
892 +units: mm
893 +
894 +The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
895 +
896 +=====
897 +arrival time =====
898 +
899 +{{code language="none"}}/FL2/Electron Diagnostic/BAM/8FL2XTDS/electron bunch arrival time (low charge){{/code}}
900 +//always saved (PBD2)//
901 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/8FL2XTDS/LOW_CHARGE_ARRIVAL_TIME{{/code}}
902 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/8FL2XTDS.LOW_CHARGE_ARRIVAL_TIME{{/code}}
903 +desc: Electron bunch arrival time measured with the BAM after the FLASH2 undulator (pulse resolved data)
904 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
905 +
906 +**FL1**{{code language="none"}}//Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}}
907 +//always saved (PBD2)//
908 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
909 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
910 +desc: Electron bunch arrival time measured with the BAM  in the accelerator  (pulse resolved data)
911 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
912 +
913 +\\
914 +
915 +{{info title="BAM hints"}}
916 +* The BAM 4DBC3 measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !).
917 +* The BAM 8FL2XTDS measures only for FLASH2 BUT has the same data structure as the other BAMS ... thus there are also (random) values in in the  FLASH1 time slot 
918 +** Structure: The first values are for FLASH1 bunches. After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ... .In case of doubt ask your local contact
919 +* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]]
920 +* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]]
921 +* a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
922 +{{/info}}
923 +
924 +
715 715  [[Contents>>doc:||anchor="Contents"]]
716 716  
927 +\\
928 +
929 +==== Timing information, rep rate etc.  (FLASH2) ====
930 +
931 +===== start time of FLASH2 =====
932 +
933 +{{code language="none"}}/FL2/Timing/start time flash2{{/code}}
934 +//always saved (PBD2)//
935 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
936 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
937 +desc: The max 600 µs acceleration time of FLASH is devided between FLASH1 and FLASH2. This 600 µs window starts with FLASH1 (up to now)  at a time"label" of 700 µs (for historic reasons). Thus the first bunch of FLASH 1 comes at "700" and the last possibel bunch comes at 1300 (700+600). After FLASH1 train is over ther is a about 70µs switching time with no bunches. Then comes the first FLASH2 bunch.  Thus if e.g. the start time of FLASH2 is 1200 it means that FLASH2 starts at column 500 (1200-700)  in the HDF5 files. (However for yet unknown reasons this may change by 2-3 colums ...)
938 +units: µs
939 +
940 +===== bunch repetition rate =====
941 +
942 +{{code language="none"}}/FL2/Timing/repetition rate{{/code}}
943 +//always saved (PBD2)//
944 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
945 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
946 +desc: repetition rate of the bunches / pulses within the burst (FLASH2)
947 +units: kHz
948 +
949 +===== actual number of pulses =====
950 +
951 +{{code language="none"}}/FL1/Timing/actual number of bunches{{/code}}
952 +//always saved (PBD2)//
953 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
954 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
955 +desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH2)
956 +units:
957 +\\
958 +
959 +===== actual pulse pattern recorded after the undulator =====
960 +
961 +{{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}}
962 +//always saved (PBD2)//
963 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
964 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
965 +desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH2)
966 +units:
967 +\\
968 +
969 +===== Train ID =====
970 +
971 +{{code language="none"}}/Timing/train ID{{/code}}
972 +//always saved (PBD2)//
973 +DOOCS prop : {{code language="none"}}none{{/code}}
974 +DAQ channel: {{code language="none"}}none{{/code}}
975 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
976 +units:
977 +\\
978 +
979 +===== Train time =====
980 +
981 +//always saved (PBD2)
982 +//{{code language="none"}}/Timing/train time{{/code}}
983 +desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
984 +units: d h min s cs
985 +\\
986 +
987 +{{code language="none"}}/Timing/time stamp{{/code}}
988 +
989 +//always saved (PBD2)//
990 +desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
991 +second column: microseconds
992 +third column: Train ID of FLASH
993 +\\
994 +
995 +[[Contents>>doc:||anchor="Contents"]]
996 +
997 +\\
998 +
999 +==== User Data (FLASH2) ====
1000 +
1001 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
1002 +
1003 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
1004 +
1005 +The most common and permanently installed device used by experiment are our ADCs:
1006 +
1007 +===== GHz ADCs =====
1008 +
1009 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
1010 +//saved on DEMAND in the user DAQ//
1011 +\\Up to now there are 4 channels available at FL24
1012 +\\\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD{{/code}}
1013 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH01/TD{{/code}}
1014 +\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH02/TD{{/code}}{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH03/TD{{/code}}
1015 +
1016 +\\
1017 +
1018 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
1019 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
1020 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00{{/code}}
1021 +
1022 +In addition there are also additional parameters saved like:
1023 +
1024 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
1025 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
1026 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
1027 +* {{code language="none"}}/CH0-CH3/offset{{/code}}: To use the full dynamic range of the ADC one can shift the base line . This offset is saved here.
1028 +
1029 +===== MHz ADCs =====
1030 +
1031 +similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
1032 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH2/TD{{/code}}
1033 +DOOCS prop : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02/CH00.TD
1034 +DAQ channel: : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02
1035 +
1036 +In addition there are also additional parameters saved like:
1037 +
1038 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
1039 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
1040 +
1041 +[[Contents>>doc:||anchor="Contents"]]
1042 +
1043 +\\
1044 +
1045 +\\
1046 +
1047 +==== Pump Probe Laser (FLASH2) ====
1048 +
1049 +There may be more information available from the "Laser DAQ". laese contact your Laser Local Contact.
1050 +
1051 +
1052 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/attenuator position{{/code}}//always saved (PBD2)//
1053 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
1054 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
1055 +desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
1056 +units : deg.
1057 +
1058 +\\
1059 +
1060 +
1061 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/polarization position{{/code}}//always saved (PBD2)//
1062 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
1063 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
1064 +desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
1065 +units : deg.
1066 +
1067 +\\
1068 +
1069 +{{code language="none"}}/FL1/Experiment/Pump probe laser/laser delay readback{{/code}}
1070 +//always saved (PBD2)//
1071 +DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}}
1072 +DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}}
1073 +desc: delay of the Pump probe laser - measured by the read back position of the motor. There is also the set value available ( upto now these values are only updating every 1-2 seconds. There is no fast encoder property as on FLASH1 available)
1074 +units : ps )
1075 +
1076 +\\
1077 +
1078 +{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS{{/code}}
1079 +//always saved (PBD)//
1080 +DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
1081 +DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
1082 +desc: rms jitter of the fs-Oscillator
1083 +units: fs
1084 +
1085 +[[Contents>>doc:||anchor="Contents"]]
1086 +
1087 +\\
1088 +
1089 +=== "/uncategorized/" ===
1090 +
1091 + If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names
1092 +
1093 +\\
1094 +
717 717  === HDF5 structure revisions ===
718 718  
719 719  Starting with Beamblock 4, August 2018, the hierarchy of the HDF group names have been adapted to reflect the new situation at FLASH. FLASH2 is operating for users quite some time now. Therefore, both accelerators appear equally in their respective HDF groups, namely "/FL1" and "/FL2". The root group of proper, by run organised HDF files have an attribute called "version". This version attribute has changed from "0.2.x" to "0.3.x". The changes in detail:
... ... @@ -828,72 +828,6 @@
828 828  [[Contents>>doc:||anchor="Contents"]]
829 829  
830 830  \\
831 -
832 -== Example code showing how to access HDF5 files ==
833 -
834 -\\
835 -
836 -=== Samples how to read HDF5 with Matlab ===
837 -
838 -The examples apply to HDF files with HDF tree version before vers. 0.3.0.
839 -
840 -(% style="color: rgb(0,128,0);" %)%% read in the needed data p=path; path(p,'D:\mess-daten\DAQ-data\hdf5\Gotthard') % add the actual folder to the path hdf5file='FLASH1_EXP-2016-03-16T1420.h5'; % data with Gotthard and VLS
841 -
842 -(% style="color: rgb(0,128,0);" %)% h5disp(hdf5file,'/','min') % to get an idea what is in the file % h5info(hdf5file,'/Experiment/Gotthard1/BL.0') % get info about the individual channel
843 -
844 -(% style="color: rgb(0,128,0);" %)% read a Number per 10 Hz pulse train:
845 -
846 -(% class="code" %)
847 -(((
848 -FEL_Wavelength_energy_server=h5read(hdf5file,'/Photon Diagnostic/Wavelength/Calculated by energy/wavelength' );
849 -)))
850 -
851 -(% style="color: rgb(0,128,0);" %)% read in a 1D array (spectrum) %GMD data GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA');
852 -
853 -(% style="color: rgb(0,128,0);" %)% This reads in all the data . One can also limit the amount of data read to a subset of the data stored in the file. e.g. for image Data (Gotthard)
854 -
855 -\\
856 -
857 -(% class="code" %)
858 -(((
859 -Start_event= 500 ; % define the first 10 Hz event
860 - Number_of_events = 20; % how many 10 Hz events to load
861 -)))
862 -
863 -(% style="color: rgb(0,128,0);" %)% read only part of the data:
864 -
865 -(% class="code" %)
866 -(((
867 -Gotthard_data=h5read(hdf5file,'/Experiment/Gotthard1/BL.0',[2 650 Start_event],[50 85 Number_of_events]);
868 -)))
869 -
870 -(% style="color: rgb(0,128,0);" %)% start stop increment "manual" for 2 D data : [start bunch number in Gotthard data start pixelin spectrum start sample in 10 Hz trains], % [number of bunches in the Gotthard data number of points in the spectrum number of spectra ]
871 -
872 -(% class="code" %)
873 -(((
874 -VLS_Spectrum=h5read(hdf5file,'/Photon Diagnostic/Wavelength/VLS online spectrometer/PCO.ROI.X',[400 Start_event],[200 Number_of_events] );
875 -
876 -)))
877 -
878 -(% style="color: rgb(0,128,0);" %)% start stop increment "manual" for 1D data : [start sample in the spectrum start sample in 10 Hz trains],[number of points in the spectrum number of spectra ]
879 -
880 -(% style="color: rgb(0,128,0);" %)%GMD data
881 -
882 -(% class="code" %)
883 -(((
884 -GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA',[1 Start_event],[40 Number_of_events] );
885 -)))
886 -
887 -[[Contents>>doc:||anchor="Contents"]]
888 -
889 -=== How to read HDF5 with Python via FLASHH5 ===
890 -
891 -With [[FlashH5>>doc:FLASHUSER.FLASHH5 for easier access of FLASH's HDF5 files]] we provide h5py based examples to access and evaluate FLASH's HDF5 files.
892 -
893 -\\
894 -
895 -== HDF5 and DOOCS ==
896 -
897 -Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>attach:FLASH1__DaqChannel2HdfNamePbd.xlsx]] HDF5 names and the corresponding DOOCS names
898 -
899 -[[Contents>>doc:||anchor="Contents"]]
1209 +{{/layout-cell}}
1210 +{{/layout-section}}
1211 +{{/layout}}