Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55

From version 3.1
edited by sndueste
on 2019/08/06 15:06
Change comment: There is no comment for this version
To version 20.1
edited by sndueste
on 2019/09/18 10:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,25 +1,8 @@
1 1  == Contents ==
2 2  
3 -\\
4 4  
5 -* General information about HDF5
6 -* FLASH HDF5 structure
7 -* Most popular FLASH parameters and their names in HDF5
8 -** FLASH1
9 -*** Beamline info (FLASH1)
10 -*** Photon Diagnostics: SASE / Spectrometer (FLASH1)
11 -*** Electron Beam properties (FLASH1)
12 -*** Timing information, rep rate etc.(FLASH1)
13 -*** Pump Probe Laser (FLASH1)
14 -*** User Data (FLASH1)
15 -** FLASH2
16 -** HDF5 structure revisions
17 -* Example code showing how to access HDF5 files
18 -** Samples how to read HDF5 with Matlab
19 -** How to read HDF5 with Python via FLASHH5
20 -* HDF5 and DOOCS
21 21  
22 -\\
5 +{{toc/}}
23 23  
24 24  \\
25 25  
... ... @@ -33,7 +33,7 @@
33 33  {{code language="none"}}> module load xray{{/code}}
34 34  {{code language="none"}}> hdfview{{/code}}
35 35  
36 -\\
19 +[[Contents>>doc:||anchor="Contents"]]
37 37  
38 38  == FLASH HDF5 structure ==
39 39  
... ... @@ -44,21 +44,21 @@
44 44  * Beamlines
45 45  * Experiment
46 46  * Timing
47 -[[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg||alt="HDF5_structure.jpg" width="700" height="500"]]
30 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg~|~|alt="HDF5_structure.jpg" width="700" height="500"~]~]>>attach:HDF5_structure.jpg]]
48 48  
49 49  A detailled description of (most) channels can be found in the lower part of the hdf5 viewer:
50 -[[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg||alt="HDF5_structure_desc.jpg" width="341" height="413"]]
33 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg~|~|alt="HDF5_structure_desc.jpg" width="341" height="413"~]~]>>attach:HDF5_structure_desc.jpg]]
51 51  
52 -\\
35 +[[Contents>>doc:||anchor="Contents"]]
53 53  
54 54  \\
55 55  
56 -== Most popular FLASH parameters and their names in HDF5 ==
39 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
57 57  
58 -The compleate list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
41 +The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
59 59  The most common and often used ones are summarized below:
60 60  
61 -Note, the HDF group and dataset names apply to our HDF tree version since vers. 0.3.0.
44 +Note, the HDF group and data set names apply to our HDF tree version since vers. 0.3.0.
62 62  
63 63  \\
64 64  
... ... @@ -96,7 +96,7 @@
96 96  //always saved (PBD)//
97 97  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
98 98  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
99 -desc: Position of the BL filterwheel 1 - to correlate with the filter material please look [[here>>doc:FLASHUSER.Filter history (BL filterwheel 12)]]
82 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
100 100  units: degree
101 101  \\
102 102  
... ... @@ -104,7 +104,7 @@
104 104  //always saved (PBD)//
105 105  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
106 106  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
107 -desc: Position of the BL filterwheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.Filter history (BL filterwheel 12)]]
90 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
108 108  units: degree
109 109  \\
110 110  
... ... @@ -112,7 +112,7 @@
112 112  //always saved (PBD)//
113 113  DOOCS prop : = TTF2.FEL/BDAF1/BDA.F1/FW.MOTOR.POS=
114 114  DAQ channel: {{code language="none"}}TTF2.FEL/BDAF1/BDA.F1/FW.MOTOR.POS{{/code}}
115 -desc: Position of the PG filterwheel 1
98 +desc: Position of the PG filter wheel 1
116 116  units: degree
117 117  \\
118 118  
... ... @@ -120,7 +120,7 @@
120 120  //always saved (PBD)//
121 121  DOOCS prop : {{code language="none"}}TTF2.FEL/BDAF2/BDA.F2/FW.MOTOR.POS{{/code}}
122 122  DAQ channel: {{code language="none"}}TTF2.FEL/BDAF2/BDA.F2/FW.MOTOR.POS{{/code}}
123 -desc: Position of the PG filterwheel 2
106 +desc: Position of the PG filter wheel 2
124 124  units: degree
125 125  \\
126 126  
... ... @@ -128,13 +128,19 @@
128 128  //always saved (PBD)//
129 129  DOOCS prop : {{code language="none"}}TTF2.FEL/PGFILTERS/PGFILTERS/FW.MOTOR.POS{{/code}}
130 130  DAQ channel: {{code language="none"}}TTF2.FEL/PGFILTERS/PGFILTERS/FW.MOTOR.POS{{/code}}
131 -desc: Position of the PG filterwheel 3
114 +desc: Position of the PG filter wheel 3
132 132  units: degree
116 +
133 133  \\
134 134  
119 +
120 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact
121 +
122 +[[Contents>>doc:||anchor="Contents"]]
123 +
135 135  \\
136 136  
137 -==== Photon Diagnostics: SASE / Spectrometer (FLASH1) ====
126 +==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) / Spectrometer (FLASH1) ====
138 138  
139 139  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
140 140  //always saved (PBD)//
... ... @@ -148,7 +148,7 @@
148 148  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
149 149  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
150 150  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
151 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]
140 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
152 152  
153 153  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}}
154 154  //always saved (PBD)//
... ... @@ -155,7 +155,7 @@
155 155  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}}
156 156  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}}
157 157  desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
158 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]
147 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
159 159  
160 160  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
161 161  //always saved (PBD)//
... ... @@ -169,7 +169,7 @@
169 169  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
170 170  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
171 171  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
172 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]
161 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
173 173  
174 174  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}}
175 175  //always saved (PBD)//
... ... @@ -176,13 +176,13 @@
176 176  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}}
177 177  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
178 178  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
179 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]
168 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
180 180  
181 181  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
182 182  //always saved (PBD)//
183 183  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
184 184  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
185 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASHUSER.Gas Monitor Detector]] (BDA, x=horizontal)
174 +desc :Beam position of the photon Beam determined by the GMD (BDA, x=horizontal)
186 186  units : mm
187 187  
188 188  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}}
... ... @@ -189,7 +189,7 @@
189 189  //always saved (PBD)//
190 190  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
191 191  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
192 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASHUSER.Gas Monitor Detector]] (BDA, y=vertical)
181 +desc :Beam position of the photon Beam determined by the GMD (BDA, y=vertical)
193 193  units : mm
194 194  
195 195  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}}
... ... @@ -196,7 +196,7 @@
196 196  //always saved (PBD)//
197 197  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
198 198  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
199 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASHUSER.Gas Monitor Detector]] (TUNNEL, x=horizontal)
188 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, x=horizontal)
200 200  units : mm
201 201  
202 202  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}}
... ... @@ -203,7 +203,7 @@
203 203  //always saved (PBD)//
204 204  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
205 205  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
206 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASHUSER.Gas Monitor Detector]] (TUNNEL, y=vertical)
195 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical)
207 207  units : mm
208 208  
209 209  {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}}
... ... @@ -269,12 +269,10 @@
269 269  desc : increment value (in nm) for each pixel for the wavelength axis of the XUV Spectrum measured with the "PG spectrometer"
270 270  units : nm
271 271  
272 -\\
261 +[[Contents>>doc:||anchor="Contents"]]
273 273  
274 274  ==== Electron Beam properties (FLASH1) ====
275 275  
276 -\\
277 -
278 278  ===== bunch charge =====
279 279  
280 280  {{code language="none"}}/FL1/Electron Diagnostic/Bunch charge/after undulator{{/code}}
... ... @@ -283,12 +283,10 @@
283 283  DAQ channel: {{code language="none"}}FLASH.DIAG/TOROID/12EXP{{/code}}
284 284  desc: electron bunch charge (FLASH1)
285 285  units: nC
286 -\\
287 287  
288 -\\
274 +=====
275 +arrival time =====
289 289  
290 -===== arrival time =====
291 -
292 292  {{code language="none"}}/FL1/Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}}
293 293  //always saved (PBD)//
294 294  DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
... ... @@ -295,10 +295,8 @@
295 295  DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
296 296  desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
297 297  units: ps (bigger numbers indicate later arrivaltime of the electrons)
298 -note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://mskwiki/index.php?title=BAM-DAQ_Channels||shape="rect"]]
283 +note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
299 299  
300 -\\
301 -
302 302  ===== electron beam profile =====
303 303  
304 304  {{code language="none"}}/FL1/Electron Diagnostic/Electron bunch profile/TDS profile{{/code}}
... ... @@ -323,10 +323,7 @@
323 323  DAQ channel: {{code language="none"}}PBD.BEAM.PROF.ML/PROFWIDTHCCTED{{/code}}
324 324  desc: rms pulse width of the measures TDS electron bunch profile
325 325  units: fs
326 -\\
327 327  
328 -\\
329 -
330 330  ===== electron bunch energy =====
331 331  
332 332  {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/average electron energy{{/code}}
... ... @@ -342,8 +342,7 @@
342 342  DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_SPECT/VAL.TD{{/code}}
343 343  DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_SPECT{{/code}}
344 344  desc: electron bunch energy bunch resolved
345 -units: (% class="twikiNewLink" %)MeV(%%)
346 -\\
325 +units: (% class="twikiNewLink" %)MeV
347 347  
348 348  \\
349 349  
... ... @@ -355,14 +355,12 @@
355 355  units: nm
356 356  \\
357 357  
358 -\\
337 +[[Contents>>doc:||anchor="Contents"]]
359 359  
360 360  \\
361 361  
362 -==== Timing information, rep rate etc.(FLASH1) ====
341 +==== Timing information, rep rate etc.  (FLASH1) ====
363 363  
364 -\\
365 -
366 366  ===== bunch repetition rate =====
367 367  
368 368  {{code language="none"}}/FL1/Timing/repetition rate{{/code}}
... ... @@ -373,8 +373,6 @@
373 373  units: kHz
374 374  \\
375 375  
376 -\\
377 -
378 378  ===== set number of pulses =====
379 379  
380 380  {{code language="none"}}/FL1/Timing/set number of bunches{{/code}}
... ... @@ -383,10 +383,7 @@
383 383  DAQ channel: {{code language="none"}}TTF2.UTIL/LASER.CONTROL/GUN/PULSE_NUM{{/code}}
384 384  desc: Number of pulses set at the gun (FLASH1)
385 385  units:
386 -\\
387 387  
388 -\\
389 -
390 390  ===== actual number of pulses =====
391 391  
392 392  {{code language="none"}}/FL1/Timing/actual number of bunches{{/code}}
... ... @@ -397,8 +397,6 @@
397 397  units:
398 398  \\
399 399  
400 -\\
401 -
402 402  ===== actual pulse pattern recorded after the undulator =====
403 403  
404 404  {{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}}
... ... @@ -409,8 +409,6 @@
409 409  units:
410 410  \\
411 411  
412 -\\
413 -
414 414  ===== Train ID =====
415 415  
416 416  {{code language="none"}}/Timing/train ID{{/code}}
... ... @@ -417,16 +417,14 @@
417 417  //always saved (PBD)//
418 418  DOOCS prop : {{code language="none"}}none{{/code}}
419 419  DAQ channel: {{code language="none"}}none{{/code}}
420 -desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
388 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 data set the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
421 421  units:
422 422  \\
423 423  
424 -\\
425 -
426 426  ===== Train time =====
427 427  
428 428  {{code language="none"}}/Timing/train time{{/code}}
429 -desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
395 +desc:Local time as array of day, hour, minute, second, and centisecond. This data set is meant for visualization purposes only. For correlations use the train ID or the Unix time of the time stamp
430 430  units: d h min s cs
431 431  \\
432 432  
... ... @@ -436,18 +436,22 @@
436 436  third column: Train ID of FLASH
437 437  \\
438 438  
439 -\\
405 +[[Contents>>doc:||anchor="Contents"]]
440 440  
441 441  \\
442 442  
443 443  ==== Pump Probe Laser (FLASH1) ====
444 444  
445 -{{code language="none"}}/FL1/Experiment/Pump probe laser/laser attenuation{{/code}} //always saved (PBD)//
411 +{{code language="none"}}/FL1/Experiment/Pump probe laser/laser attenuation{{/code}}
412 +
413 +//always saved (PBD)//
446 446  DOOCS prop : {{code language="none"}}TTF2.FEL/PPDELAYCAL/PPDELAYCAL/ROT2.CURRENT{{/code}}
447 447  DAQ channel: {{code language="none"}}TTF2.FEL/PPDELAYCAL/PPDELAYCAL/ROT2.CURRENT{{/code}}
448 448  desc: attenuation of the PPLaser (rotation of a waveplate)
449 449  units : 0 no transmission , 1: full transmission
450 450  
419 +\\
420 +
451 451  {{code language="none"}}/FL1/Experiment/Pump probe laser/laser delay{{/code}}
452 452  //always saved (PBD)//
453 453  DOOCS prop : {{code language="none"}}TTF2.FEL/PPDELAYCAL/PPDELAYCAL/DLY1.CURRENT{{/code}}
... ... @@ -455,6 +455,8 @@
455 455  desc: delay of the Pump probe laser - measured by the read back position of the motor. only read out every secound ... better use the encoder
456 456  units : ps ( pos delay means IR comes later)
457 457  
428 +\\
429 +
458 458  {{code language="none"}}/FL1/Experiment/Pump probe laser/delay line IK220.0/ENC.DELAY{{/code}}
459 459  //always saved (PBD)//
460 460  DOOCS prop : {{code language="none"}}TTF2.FEL/DELLINE.ENC/IK220.0/ENC.DELAY{{/code}}
... ... @@ -462,6 +462,8 @@
462 462  subsystem: {{code language="none"}}DELLINE.ENC{{/code}} desc : delay of the Pump probe laser - measured by an encoder. The position is read out with 10Hz train synchronized and should be used to determine the actual laser delay (the motor position is only read out about every second
463 463  units : ps ( pos delay means IR comes later)
464 464  
437 +\\
438 +
465 465  {{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO{{/code}}
466 466  //always saved (PBD)//
467 467  DOOCS prop : {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}}
... ... @@ -478,17 +478,21 @@
478 478  
479 479  \\
480 480  
481 -\\
455 +[[Contents>>doc:||anchor="Contents"]]
482 482  
483 483  \\
484 484  
485 485  ==== User Data (FLASH1) ====
486 486  
487 -\\
461 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
488 488  
463 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
464 +
465 +The most common and permanently installed device used by experiment are our ADCs:
466 +
489 489  ===== GHz ADCs =====
490 490  
491 -ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]
469 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
492 492  //saved on DEMAND in the user DAQ//
493 493  \\The HDF5 names for the ADC traces are depending on the beamline :
494 494  \\PG Beamline:
... ... @@ -511,184 +511,540 @@
511 511  here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
512 512  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}}
513 513  
514 -in addition there are also additional parameters saved like:
492 +In addition there are also additional parameters saved like:
515 515  
516 -* sample frequency (in MHz)
517 -* error (state)
518 -* offset
494 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
495 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
496 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
519 519  
520 -~|
521 -
522 522  ===== MHz ADCs =====
523 523  
524 -similar to the GHz ADCs the MHz ASDsa re saved with HDF5 names like:
500 +similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
525 525  {{code language="none"}}/FL1/Experiment/BL1/SIS8300 100MHz ADC/CH2/TD{{/code}}
526 526  DOOCS prop : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02/CH00.TD
527 527  DAQ channel: : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02
528 528  
505 +In addition there are also additional parameters saved like:
506 +
507 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
508 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
509 +
510 +[[Contents>>doc:||anchor="Contents"]]
511 +
529 529  \\
530 530  
531 531  \\
532 532  
516 +\\
517 +
533 533  === FLASH2 ===
534 534  
520 +There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
521 +
522 +==== Beamline info (FLASH2) ====
523 +
524 +(% style="color: rgb(255,153,0);" %)(not yet available){{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}(%%)
525 +(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%)
526 +(% style="color: rgb(193,199,208);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
527 +(% style="color: rgb(193,199,208);" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
528 +(% style="color: rgb(193,199,208);" %)desc: set pressure in the gas attenuator (%%)
529 +(% style="color: rgb(193,199,208);" %)units: mbar(%%)
535 535  \\
536 536  
532 +{{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
533 +//always saved (PBD2)//
534 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER/CH00.TD{{/code}}
535 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER{{/code}}
536 +desc: BL Beamline Fast shutter state: 1 is open, 0 is closed ( for technical reasons there are 100 vales of this state saved ...)
537 +units: none
538 +
539 +
540 +{{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 1{{/code}}
541 +//always saved (PBD2)//
542 +DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
543 +DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
544 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]**
545 +units: degree
546 +\\
547 +
548 +
549 +//always saved (PBD2)//
550 +\\\\**[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]**
551 +{{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2 DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}}
552 +
553 +\\
554 +
555 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact
556 +
557 +[[Contents>>doc:||anchor="Contents"]]
558 +
559 +\\
560 +
561 +\\
562 +
563 +==== Photon Diagnostics SASE ([[XGMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]] - FLASH2) ====
564 +
565 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
566 +//always saved (PBD2)//
567 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
568 +DAQ channel:{{code language="none"}} FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
569 +desc : calibrated average ( ~~ 20 sec averaging time ) SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current)
570 +units : microJ
571 +
572 +\\
573 +
574 +(% style="color: rgb(255,204,0);" %)average Sigma    to be included in
575 +
576 +(% style="color: rgb(193,199,208);" %){{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel uncertainty{{/code}} (%%)
577 +(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%)
578 +(% style="color: rgb(193,199,208);" %)DOOCS prop : FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%)
579 +(% style="color: rgb(193,199,208);" %)DAQ channel: FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%)
580 +(% style="color: rgb(193,199,208);" %)desc :  This parameter gives an indication of the error of the measurement of the average pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)
581 +(% style="color: rgb(193,199,208);" %)units : microJ
582 +
583 +\\
584 +
585 +\\
586 +
587 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
588 +//always saved (PBD2)//
589 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
590 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
591 +desc : Energy per pulse measured in the Tunnel  (in fromt of the gas attenuator and the apertures in the Hall)
592 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
593 +
594 +\\
595 +
596 +\\
597 +
598 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel uncertainty (sigma){{/code}}
599 +//always saved (PBD2)//
600 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.SIGMA.TD{{/code}}
601 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:4{{/code}}
602 +desc :(% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)
603 +units : a.u. (more or less µJ - related to the value of the pulse energy )
604 +
605 +
606 +{{code language="none"}}{{/code}}
607 +
608 +All values for the GMD are also available for the** HALL GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between Hall and Tunnel signal shows the attenuation. **BUT NOTE** that the filter unit and the Aperture 4 are downstream the GMD. So if filters and aperture are used this influence is NOT measured by the GMD hall !
609 +
610 +\\
611 +
612 +Besides  pulse energy the GMD also provides information about the beam position
613 +
614 +\\
615 +
616 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Average Beam position/position tunnel horizontal{{/code}}
617 +//always saved (PBD2)//
618 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
619 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
620 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
621 +units : mm
622 +
623 +\\
624 +
625 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Average Beam position/position tunnel vertical{{/code}}
626 +//always saved (PBD2)//
627 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
628 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
629 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
630 +units : mm
631 +
632 +\\
633 +
634 +
635 +//always saved (PBD2)//
636 +\\\\{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TDDAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 desc: {{/code}}Besides the well calibrated averaged beam position information there is also the option
637 +{{code language="none"}}to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...)units : mm    {{/code}}
638 +
639 +{{code language="none"}}(x=horizontal, y = vertial){{/code}}
640 +
641 +again the same parameter set is available for the **HALL GMD**
642 +
643 +\\
644 +
645 +\\
646 +
647 +==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
648 +
649 +for more info see:** [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]**
650 +
651 +(The OPIS hall is not installed yet ...)
652 +
653 +\\
654 +
655 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean photon energy{{/code}}
656 +// saved opon request (PBD2)//
657 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042{{/code}}
658 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042{{/code}}
659 +desc : mean photon energy ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
660 +units : eV
661 +
662 +\\
663 +
664 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelength{{/code}}
665 +// saved opon request (PBD2)//
666 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
667 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
668 +desc : meanwavelength ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
669 +units : nm
670 +
671 +\\
672 +
673 +{{code language="none"}}/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/number of analyzed bunch        (in older version this can be found in OPIS tunnel/Expert stuff/General operation parameters/){{/code}}
674 +// saved opon request (PBD2)//
675 +DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL060{{/code}}
676 +DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL060{{/code}}
677 +desc : The bunch number of the bunch used for the wavelength calculation
678 +units :
679 +
680 +\\
681 +
682 +If Opis is running typically on the the averaged data is saved. For several experiments it may make sense to save the information for each single bunch. This is up to now done by savng the compleate ADC trace of the TOF setup. This is a huge amount of data and needs processing. This has to be performed after the beamtime in close contact to [[Markus Braune>>mailto:markus.braune@desy.de||shape="rect"]] ( respobsible for [[OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]])
683 +
684 +\\
685 +
686 +In case OPIS was not operating there is still informaton about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
687 +
688 +\\
689 +
690 +\\
691 +
692 +==== Electron Beam properties (FLASH2) ====
693 +
694 +===== bunch charge =====
695 +
696 +{{code language="none"}}/FL2/Electron Diagnostic/Bunch charge/after undulator{{/code}}
697 +//always saved (PBD2)//
698 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
699 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
700 +desc: electron bunch charge FLASH2 (average value for each bunchtrain).
701 +units: nC
702 +
703 +\\
704 +
705 +===== undulator settings =====
706 +
707 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
708 +//always saved (PBD2)//
709 +DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
710 +DAQ channel:  {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
711 +desc: Set value for the anticipated wavelength . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ...
712 +units: nm
713 +
714 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE14 gap{{/code}}
715 +//always saved (PBD2)//
716 +DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
717 +DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
718 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
719 +units: mm
720 +
721 +The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
722 +
723 +=====
724 +arrival time =====
725 +
726 +**FL1**{{code language="none"}}//Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}}
727 +//always saved (PBD2)//
728 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
729 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
730 +desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
731 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
732 +
733 +The BAM measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches.
734 +After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ...
735 +
736 +Docu for BAM:  [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
737 +
738 +
739 +[[Contents>>doc:||anchor="Contents"]]
740 +
741 +\\
742 +
743 +==== Timing information, rep rate etc.  (FLASH2) ====
744 +
745 +===== start time of FLASH2 =====
746 +
747 +{{code language="none"}}/FL2/Timing/start time flash2{{/code}}
748 +//always saved (PBD2)//
749 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
750 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
751 +desc: The max 600 µs acceleration time of FLASH is devided between FLASH1 and FLASH2. This 600 µs window starts with FLASH1 (up to now)  at a time"label" of 700 µs (for historic reasons). Thus the first bunch of FLASH 1 comes at "700" and the last possibel bunch comes at 1300 (700+600). After FLASH1 train is over ther is a about 70µs switching time with no bunches. Then comes the first FLASH2 bunch.  Thus if e.g. the start time of FLASH2 is 1200 it means that FLASH2 starts at column 500 (1200-700)  in the HDF5 files. (However for yet unknown reasons this may change by 2-3 colums ...)
752 +units: µs
753 +
754 +===== bunch repetition rate =====
755 +
756 +{{code language="none"}}/FL2/Timing/repetition rate{{/code}}
757 +//always saved (PBD2)//
758 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
759 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
760 +desc: repetition rate of the bunches / pulses within the burst (FLASH2)
761 +units: kHz
762 +
763 +===== actual number of pulses =====
764 +
765 +{{code language="none"}}/FL1/Timing/actual number of bunches{{/code}}
766 +//always saved (PBD2)//
767 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
768 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
769 +desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH2)
770 +units:
771 +\\
772 +
773 +===== actual pulse pattern recorded after the undulator =====
774 +
775 +{{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}}
776 +//always saved (PBD2)//
777 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
778 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
779 +desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH2)
780 +units:
781 +\\
782 +
783 +===== Train ID =====
784 +
785 +{{code language="none"}}/Timing/train ID{{/code}}
786 +//always saved (PBD2)//
787 +DOOCS prop : {{code language="none"}}none{{/code}}
788 +DAQ channel: {{code language="none"}}none{{/code}}
789 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
790 +units:
791 +\\
792 +
793 +===== Train time =====
794 +
795 +//always saved (PBD2)
796 +//{{code language="none"}}/Timing/train time{{/code}}
797 +desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
798 +units: d h min s cs
799 +\\
800 +
801 +{{code language="none"}}/Timing/time stamp{{/code}}
802 +
803 +//always saved (PBD2)//
804 +desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
805 +second column: microseconds
806 +third column: Train ID of FLASH
807 +\\
808 +
809 +[[Contents>>doc:||anchor="Contents"]]
810 +
811 +\\
812 +
813 +==== User Data (FLASH2) ====
814 +
815 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
816 +
817 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
818 +
819 +The most common and permanently installed device used by experiment are our ADCs:
820 +
821 +===== GHz ADCs =====
822 +
823 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
824 +//saved on DEMAND in the user DAQ//
825 +\\Up to now there are 4 channels available at FL24
826 +\\\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD{{/code}}
827 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH01/TD{{/code}}
828 +\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH02/TD{{/code}}{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH03/TD{{/code}}
829 +
830 +\\
831 +
832 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
833 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
834 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00{{/code}}
835 +
836 +In addition there are also additional parameters saved like:
837 +
838 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
839 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
840 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
841 +* {{code language="none"}}/CH0-CH3/offset{{/code}}: To use the full dynamic range of the ADC one can shift the base line . This offset is saved here.
842 +
843 +===== MHz ADCs =====
844 +
845 +similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
846 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH2/TD{{/code}}
847 +DOOCS prop : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02/CH00.TD
848 +DAQ channel: : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02
849 +
850 +In addition there are also additional parameters saved like:
851 +
852 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
853 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
854 +
855 +[[Contents>>doc:||anchor="Contents"]]
856 +
857 +\\
858 +
859 +\\
860 +
861 +\\
862 +
863 +\\
864 +
865 +\\
866 +
867 +\\
868 +
869 +\\
870 +
537 537  (% class="wrapped" %)
538 538  |=(((
539 -[[DAQ name>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=0;table=1;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]
873 +\\
540 540  )))|=(((
541 -[[HDF5 name>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=1;table=1;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]
875 +\\
542 542  )))
543 543  |(((
544 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP
878 +\\
545 545  )))|(((
546 -/FL2/Electron Diagnostic/Undulator setting/SASE03 gap
880 +\\
547 547  )))
548 548  |(((
549 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP
883 +\\
550 550  )))|(((
551 -/FL2/Electron Diagnostic/Undulator setting/SASE14 gap
885 +\\
552 552  )))
553 553  |(((
554 -TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH
888 +\\
555 555  )))|(((
556 -/FL2/Electron Diagnostic/Undulator setting/set wavelength
890 +\\
557 557  )))
558 558  |(((
559 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX.UJ
893 +\\
560 560  )))|(((
561 -/FL2/Photon Diagnostic/GMD/Average energy/hall
895 +\\
562 562  )))
563 563  |(((
564 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX
898 +\\
565 565  )))|(((
566 -/FL2/Photon Diagnostic/GMD/Average energy/hall (raw)
900 +\\
567 567  )))
568 568  |(((
569 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ
903 +\\
570 570  )))|(((
571 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel
905 +\\
572 572  )))
573 573  |(((
574 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX
908 +\\
575 575  )))|(((
576 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel (raw)
910 +\\
577 577  )))
578 578  |(((
579 -FLASH.FEL/XGM.POSMON/FL2.HALL/IX.POS
913 +\\
580 580  )))|(((
581 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall horizontal
915 +\\
582 582  )))
583 583  |(((
584 -FLASH.FEL/XGM.POSMON/FL2.HALL/IY.POS
918 +\\
585 585  )))|(((
586 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall vertical
920 +\\
587 587  )))
588 588  |(((
589 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS
923 +\\
590 590  )))|(((
591 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel horizontal
925 +\\
592 592  )))
593 593  |(((
594 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS
928 +\\
595 595  )))|(((
596 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel vertical
930 +\\
597 597  )))
598 598  |(((
599 -FLASH.FEL/XGM.BPM/FL2.HALL:0
933 +\\
600 600  )))|(((
601 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall horizontal
935 +\\
602 602  )))
603 603  |(((
604 -FLASH.FEL/XGM.BPM/FL2.HALL:1
938 +\\
605 605  )))|(((
606 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall vertical
940 +\\
607 607  )))
608 608  |(((
609 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:0
943 +\\
610 610  )))|(((
611 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel horizontal
945 +\\
612 612  )))
613 613  |(((
614 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:1
948 +\\
615 615  )))|(((
616 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical
950 +\\
617 617  )))
618 618  |(((
619 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:1
953 +\\
620 620  )))|(((
621 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy aux tunnel
955 +\\
622 622  )))
623 623  |(((
624 -FLASH.FEL/XGM.INTENSITY/FL2.HALL
958 +\\
625 625  )))|(((
626 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
960 +\\
627 627  )))
628 628  |(((
629 -FLASH.FEL/XGM.INTENSITY/FL2.HALL:0
963 +\\
630 630  )))|(((
631 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
965 +\\
632 632  )))
633 633  |(((
634 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL
968 +\\
635 635  )))|(((
636 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
970 +\\
637 637  )))
638 638  |(((
639 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:0
973 +\\
640 640  )))|(((
641 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
975 +\\
642 642  )))
643 643  |(((
644 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042
978 +\\
645 645  )))|(((
646 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean phtoton energy
980 +\\
647 647  )))
648 648  |(((
649 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040
983 +\\
650 650  )))|(((
651 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelengt
985 +\\
652 652  )))
653 653  |(((
654 -FLASH.FEL/ADC.ADQ/OPIS1.CH02
988 +\\
655 655  )))|(((
656 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Raw data/CH02
990 +\\
657 657  )))
658 658  |(((
659 -FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2
993 +\\
660 660  )))|(((
661 -/FL2/Electron Diagnostic/Bunch charge/after undulator
995 +\\
662 662  )))
663 663  |(((
664 -FLASH.DIAG/PBD2.TOROID.ML/3GUN/CHARGE.FLASH2
998 +\\
665 665  )))|(((
666 -/FL2/Electron Diagnostic/Bunch charge/at gun
1000 +\\
667 667  )))
668 668  |(((
669 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR1.MOT1/FPOS
1003 +\\
670 670  )))|(((
671 -/FL2/Beamlines/Tunnel Apertures/position aperture1 horizontal
1005 +\\
672 672  )))
673 673  |(((
674 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR2.MOT1/FPOS
1008 +\\
675 675  )))|(((
676 -/FL2/Beamlines/Tunnel Apertures/position aperture1 vertical
1010 +\\
677 677  )))
678 678  |(((
679 -FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER
1013 +\\
680 680  )))|(((
681 -/FL2/Beamlines/FL20/Shutter/channel 0
1015 +\\
682 682  )))
683 683  |(((
684 -FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00
1018 +\\
685 685  )))|(((
686 -/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD
1020 +\\
687 687  )))
688 688  |(((
689 -FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH00
1023 +\\
690 690  )))|(((
691 -/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH0/TD
1025 +\\
692 692  )))
693 693  |(((
694 694  FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD
... ... @@ -723,7 +723,7 @@
723 723  
724 724  \\
725 725  
726 -\\
1060 +[[Contents>>doc:||anchor="Contents"]]
727 727  
728 728  === HDF5 structure revisions ===
729 729  
... ... @@ -739,9 +739,9 @@
739 739  
740 740  (% class="wrapped" %)
741 741  |=(((
742 -[[earlier HDF path (vers. 0.2)>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=0;table=2;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]
1076 +earlier HDF path (vers. 0.2)
743 743  )))|=(((
744 -[[is now (vers. 0.3)>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=1;table=2;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]
1078 +is now (vers. 0.3)
745 745  )))
746 746  |(((
747 747  /Photon Diagnostic/GMD/Beam position/position BDA x
... ... @@ -836,7 +836,7 @@
836 836  
837 837  \\
838 838  
839 -\\
1173 +[[Contents>>doc:||anchor="Contents"]]
840 840  
841 841  \\
842 842  
... ... @@ -895,7 +895,7 @@
895 895  GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA',[1 Start_event],[40 Number_of_events] );
896 896  )))
897 897  
898 -\\
1232 +[[Contents>>doc:||anchor="Contents"]]
899 899  
900 900  === How to read HDF5 with Python via FLASHH5 ===
901 901  
... ... @@ -906,3 +906,5 @@
906 906  == HDF5 and DOOCS ==
907 907  
908 908  Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>attach:FLASH1__DaqChannel2HdfNamePbd.xlsx]] HDF5 names and the corresponding DOOCS names
1243 +
1244 +[[Contents>>doc:||anchor="Contents"]]