Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55

From version 11.1
edited by sndueste
on 2019/09/17 16:50
Change comment: There is no comment for this version
To version 20.1
edited by sndueste
on 2019/09/18 10:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,25 +1,8 @@
1 1  == Contents ==
2 2  
3 -\\
4 4  
5 -* [[General information about HDF5>>doc:||anchor="General information about HDF5"]]
6 -* [[FLASH HDF5 structure>>doc:||anchor="FLASH HDF5 structure"]]
7 -* [[Most popular FLASH parameters and their names in HDF5>>doc:||anchor="Most popular FLASH parameters and their names in HDF5"]]
8 -** [[FLASH1>>doc:||anchor="FLASH1"]]
9 -*** [[Beamline info (FLASH1)>>doc:||anchor="Beamline info (FLASH1)"]]
10 -*** [[Photon Diagnostics SASE / Spectrometer (FLASH1)>>doc:||anchor="Photon Diagnostics SASE / Spectrometer (FLASH1)"]]
11 -*** [[Electron Beam properties (FLASH1)>>doc:||anchor="Electron Beam properties (FLASH1)"]]
12 -*** [[Timing information, rep rate etc.(FLASH1)>>doc:||anchor="Timing information, rep rate etc.(FLASH1)"]]
13 -*** [[Pump Probe Laser (FLASH1)>>doc:||anchor="Pump Probe Laser (FLASH1)"]]
14 -*** [[User Data (FLASH1)>>doc:||anchor="User Data (FLASH1)"]]
15 -** [[FLASH2>>doc:||anchor="FLASH2"]]
16 -** [[HDF5 structure revisions>>doc:||anchor="HDF5 structure revisions"]]
17 -* [[Example code showing how to access HDF5 files>>doc:||anchor="Example code showing how to access HDF5 files"]]
18 -** [[Samples how to read HDF5 with Matlab>>doc:||anchor="Samples how to read HDF5 with Matlab"]]
19 -** [[How to read HDF5 with Python via FLASHH5>>doc:||anchor="How to read HDF5 with Python via FLASHH5"]]
20 -* [[HDF5 and DOOCS>>doc:||anchor="HDF5 and DOOCS"]]
21 21  
22 -\\
5 +{{toc/}}
23 23  
24 24  \\
25 25  
... ... @@ -53,7 +53,7 @@
53 53  
54 54  \\
55 55  
56 -== Most popular FLASH parameters and their names in HDF5 ==
39 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
57 57  
58 58  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
59 59  The most common and often used ones are summarized below:
... ... @@ -154,7 +154,7 @@
154 154  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
155 155  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
156 156  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
157 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
140 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
158 158  
159 159  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}}
160 160  //always saved (PBD)//
... ... @@ -161,7 +161,7 @@
161 161  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}}
162 162  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}}
163 163  desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
164 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
147 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
165 165  
166 166  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
167 167  //always saved (PBD)//
... ... @@ -175,7 +175,7 @@
175 175  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
176 176  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
177 177  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
178 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
161 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
179 179  
180 180  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}}
181 181  //always saved (PBD)//
... ... @@ -182,13 +182,13 @@
182 182  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}}
183 183  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
184 184  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
185 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
168 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
186 186  
187 187  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
188 188  //always saved (PBD)//
189 189  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
190 190  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
191 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, x=horizontal)
174 +desc :Beam position of the photon Beam determined by the GMD (BDA, x=horizontal)
192 192  units : mm
193 193  
194 194  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}}
... ... @@ -195,7 +195,7 @@
195 195  //always saved (PBD)//
196 196  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
197 197  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
198 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, y=vertical)
181 +desc :Beam position of the photon Beam determined by the GMD (BDA, y=vertical)
199 199  units : mm
200 200  
201 201  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}}
... ... @@ -202,7 +202,7 @@
202 202  //always saved (PBD)//
203 203  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
204 204  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
205 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, x=horizontal)
188 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, x=horizontal)
206 206  units : mm
207 207  
208 208  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}}
... ... @@ -209,7 +209,7 @@
209 209  //always saved (PBD)//
210 210  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
211 211  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
212 -desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, y=vertical)
195 +desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical)
213 213  units : mm
214 214  
215 215  {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}}
... ... @@ -402,7 +402,7 @@
402 402  //always saved (PBD)//
403 403  DOOCS prop : {{code language="none"}}none{{/code}}
404 404  DAQ channel: {{code language="none"}}none{{/code}}
405 -desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
388 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 data set the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
406 406  units:
407 407  \\
408 408  
... ... @@ -409,7 +409,7 @@
409 409  ===== Train time =====
410 410  
411 411  {{code language="none"}}/Timing/train time{{/code}}
412 -desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
395 +desc:Local time as array of day, hour, minute, second, and centisecond. This data set is meant for visualization purposes only. For correlations use the train ID or the Unix time of the time stamp
413 413  units: d h min s cs
414 414  \\
415 415  
... ... @@ -475,9 +475,15 @@
475 475  
476 476  ==== User Data (FLASH1) ====
477 477  
461 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
462 +
463 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
464 +
465 +The most common and permanently installed device used by experiment are our ADCs:
466 +
478 478  ===== GHz ADCs =====
479 479  
480 -ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]
469 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
481 481  //saved on DEMAND in the user DAQ//
482 482  \\The HDF5 names for the ADC traces are depending on the beamline :
483 483  \\PG Beamline:
... ... @@ -500,14 +500,12 @@
500 500  here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
501 501  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}}
502 502  
503 -in addition there are also additional parameters saved like:
492 +In addition there are also additional parameters saved like:
504 504  
505 -* sample frequency (in MHz)
506 -* error (state)
507 -* offset
494 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
495 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
496 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
508 508  
509 -~|
510 -
511 511  ===== MHz ADCs =====
512 512  
513 513  similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
... ... @@ -515,10 +515,19 @@
515 515  DOOCS prop : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02/CH00.TD
516 516  DAQ channel: : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02
517 517  
518 -\\
505 +In addition there are also additional parameters saved like:
519 519  
507 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
508 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
509 +
520 520  [[Contents>>doc:||anchor="Contents"]]
521 521  
512 +\\
513 +
514 +\\
515 +
516 +\\
517 +
522 522  === FLASH2 ===
523 523  
524 524  There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
... ... @@ -526,11 +526,11 @@
526 526  ==== Beamline info (FLASH2) ====
527 527  
528 528  (% style="color: rgb(255,153,0);" %)(not yet available){{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}(%%)
529 -//always saved (PBD2)//
530 -DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}}
531 -DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}}
532 -desc: set pressure in the gas attenuator
533 -units: mbar
525 +(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%)
526 +(% style="color: rgb(193,199,208);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
527 +(% style="color: rgb(193,199,208);" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
528 +(% style="color: rgb(193,199,208);" %)desc: set pressure in the gas attenuator (%%)
529 +(% style="color: rgb(193,199,208);" %)units: mbar(%%)
534 534  \\
535 535  
536 536  {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
... ... @@ -545,13 +545,13 @@
545 545  //always saved (PBD2)//
546 546  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
547 547  DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
548 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
544 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]**
549 549  units: degree
550 550  \\
551 551  
552 552  
553 553  //always saved (PBD2)//
554 -\\\\[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
550 +\\\\**[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]**
555 555  {{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2 DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}}
556 556  
557 557  \\
... ... @@ -593,7 +593,7 @@
593 593  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
594 594  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
595 595  desc : Energy per pulse measured in the Tunnel  (in fromt of the gas attenuator and the apertures in the Hall)
596 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
592 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
597 597  
598 598  \\
599 599  
... ... @@ -621,7 +621,7 @@
621 621  //always saved (PBD2)//
622 622  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
623 623  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
624 -desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (tunnel, x=horizontal)
620 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
625 625  units : mm
626 626  
627 627  \\
... ... @@ -630,14 +630,12 @@
630 630  //always saved (PBD2)//
631 631  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
632 632  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
633 -desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (tunnel, x=horizontal)
629 +desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
634 634  units : mm
635 635  
636 636  \\
637 637  
638 -\\
639 639  
640 -
641 641  //always saved (PBD2)//
642 642  \\\\{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TDDAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 desc: {{/code}}Besides the well calibrated averaged beam position information there is also the option
643 643  {{code language="none"}}to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...)units : mm    {{/code}}
... ... @@ -650,9 +650,9 @@
650 650  
651 651  \\
652 652  
653 -==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
647 +==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
654 654  
655 -for more info see: [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]
649 +for more info see:** [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]**
656 656  
657 657  (The OPIS hall is not installed yet ...)
658 658  
... ... @@ -689,173 +689,346 @@
689 689  
690 690  \\
691 691  
686 +In case OPIS was not operating there is still informaton about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
687 +
692 692  \\
693 693  
694 694  \\
695 695  
692 +==== Electron Beam properties (FLASH2) ====
693 +
694 +===== bunch charge =====
695 +
696 +{{code language="none"}}/FL2/Electron Diagnostic/Bunch charge/after undulator{{/code}}
697 +//always saved (PBD2)//
698 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
699 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
700 +desc: electron bunch charge FLASH2 (average value for each bunchtrain).
701 +units: nC
702 +
696 696  \\
697 697  
705 +===== undulator settings =====
706 +
707 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
708 +//always saved (PBD2)//
709 +DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
710 +DAQ channel:  {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
711 +desc: Set value for the anticipated wavelength . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ...
712 +units: nm
713 +
714 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE14 gap{{/code}}
715 +//always saved (PBD2)//
716 +DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
717 +DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
718 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
719 +units: mm
720 +
721 +The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
722 +
723 +=====
724 +arrival time =====
725 +
726 +**FL1**{{code language="none"}}//Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}}
727 +//always saved (PBD2)//
728 +DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}}
729 +DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
730 +desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
731 +units: ps (bigger numbers indicate later arrivaltime of the electrons)
732 +
733 +The BAM measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches.
734 +After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ...
735 +
736 +Docu for BAM:  [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
737 +
738 +
739 +[[Contents>>doc:||anchor="Contents"]]
740 +
698 698  \\
699 699  
743 +==== Timing information, rep rate etc.  (FLASH2) ====
744 +
745 +===== start time of FLASH2 =====
746 +
747 +{{code language="none"}}/FL2/Timing/start time flash2{{/code}}
748 +//always saved (PBD2)//
749 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
750 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
751 +desc: The max 600 µs acceleration time of FLASH is devided between FLASH1 and FLASH2. This 600 µs window starts with FLASH1 (up to now)  at a time"label" of 700 µs (for historic reasons). Thus the first bunch of FLASH 1 comes at "700" and the last possibel bunch comes at 1300 (700+600). After FLASH1 train is over ther is a about 70µs switching time with no bunches. Then comes the first FLASH2 bunch.  Thus if e.g. the start time of FLASH2 is 1200 it means that FLASH2 starts at column 500 (1200-700)  in the HDF5 files. (However for yet unknown reasons this may change by 2-3 colums ...)
752 +units: µs
753 +
754 +===== bunch repetition rate =====
755 +
756 +{{code language="none"}}/FL2/Timing/repetition rate{{/code}}
757 +//always saved (PBD2)//
758 +DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
759 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
760 +desc: repetition rate of the bunches / pulses within the burst (FLASH2)
761 +units: kHz
762 +
763 +===== actual number of pulses =====
764 +
765 +{{code language="none"}}/FL1/Timing/actual number of bunches{{/code}}
766 +//always saved (PBD2)//
767 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
768 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
769 +desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH2)
770 +units:
700 700  \\
701 701  
773 +===== actual pulse pattern recorded after the undulator =====
774 +
775 +{{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}}
776 +//always saved (PBD2)//
777 +DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
778 +DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
779 +desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH2)
780 +units:
702 702  \\
703 703  
783 +===== Train ID =====
784 +
785 +{{code language="none"}}/Timing/train ID{{/code}}
786 +//always saved (PBD2)//
787 +DOOCS prop : {{code language="none"}}none{{/code}}
788 +DAQ channel: {{code language="none"}}none{{/code}}
789 +desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
790 +units:
791 +\\
792 +
793 +===== Train time =====
794 +
795 +//always saved (PBD2)
796 +//{{code language="none"}}/Timing/train time{{/code}}
797 +desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
798 +units: d h min s cs
799 +\\
800 +
801 +{{code language="none"}}/Timing/time stamp{{/code}}
802 +
803 +//always saved (PBD2)//
804 +desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
805 +second column: microseconds
806 +third column: Train ID of FLASH
807 +\\
808 +
809 +[[Contents>>doc:||anchor="Contents"]]
810 +
811 +\\
812 +
813 +==== User Data (FLASH2) ====
814 +
815 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
816 +
817 +NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
818 +
819 +The most common and permanently installed device used by experiment are our ADCs:
820 +
821 +===== GHz ADCs =====
822 +
823 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
824 +//saved on DEMAND in the user DAQ//
825 +\\Up to now there are 4 channels available at FL24
826 +\\\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD{{/code}}
827 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH01/TD{{/code}}
828 +\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH02/TD{{/code}}{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH03/TD{{/code}}
829 +
830 +\\
831 +
832 +DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
833 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
834 +DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00{{/code}}
835 +
836 +In addition there are also additional parameters saved like:
837 +
838 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
839 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
840 +* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
841 +* {{code language="none"}}/CH0-CH3/offset{{/code}}: To use the full dynamic range of the ADC one can shift the base line . This offset is saved here.
842 +
843 +===== MHz ADCs =====
844 +
845 +similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
846 +{{code language="none"}}/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH2/TD{{/code}}
847 +DOOCS prop : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02/CH00.TD
848 +DAQ channel: : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02
849 +
850 +In addition there are also additional parameters saved like:
851 +
852 +* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
853 +* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
854 +
855 +[[Contents>>doc:||anchor="Contents"]]
856 +
857 +\\
858 +
859 +\\
860 +
861 +\\
862 +
863 +\\
864 +
865 +\\
866 +
867 +\\
868 +
869 +\\
870 +
704 704  (% class="wrapped" %)
705 705  |=(((
706 -DAQ name
873 +\\
707 707  )))|=(((
708 -HDF5 name
875 +\\
709 709  )))
710 710  |(((
711 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP
878 +\\
712 712  )))|(((
713 -/FL2/Electron Diagnostic/Undulator setting/SASE03 gap
880 +\\
714 714  )))
715 715  |(((
716 -FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP
883 +\\
717 717  )))|(((
718 -/FL2/Electron Diagnostic/Undulator setting/SASE14 gap
885 +\\
719 719  )))
720 720  |(((
721 -TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH
888 +\\
722 722  )))|(((
723 -/FL2/Electron Diagnostic/Undulator setting/set wavelength
890 +\\
724 724  )))
725 725  |(((
726 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX.UJ
893 +\\
727 727  )))|(((
728 -/FL2/Photon Diagnostic/GMD/Average energy/hall
895 +\\
729 729  )))
730 730  |(((
731 -FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX
898 +\\
732 732  )))|(((
733 -/FL2/Photon Diagnostic/GMD/Average energy/hall (raw)
900 +\\
734 734  )))
735 735  |(((
736 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ
903 +\\
737 737  )))|(((
738 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel
905 +\\
739 739  )))
740 740  |(((
741 -FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX
908 +\\
742 742  )))|(((
743 -/FL2/Photon Diagnostic/GMD/Average energy/tunnel (raw)
910 +\\
744 744  )))
745 745  |(((
746 -FLASH.FEL/XGM.POSMON/FL2.HALL/IX.POS
913 +\\
747 747  )))|(((
748 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall horizontal
915 +\\
749 749  )))
750 750  |(((
751 -FLASH.FEL/XGM.POSMON/FL2.HALL/IY.POS
918 +\\
752 752  )))|(((
753 -/FL2/Photon Diagnostic/GMD/Average beam position/position hall vertical
920 +\\
754 754  )))
755 755  |(((
756 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS
923 +\\
757 757  )))|(((
758 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel horizontal
925 +\\
759 759  )))
760 760  |(((
761 -FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS
928 +\\
762 762  )))|(((
763 -/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel vertical
930 +\\
764 764  )))
765 765  |(((
766 -FLASH.FEL/XGM.BPM/FL2.HALL:0
933 +\\
767 767  )))|(((
768 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall horizontal
935 +\\
769 769  )))
770 770  |(((
771 -FLASH.FEL/XGM.BPM/FL2.HALL:1
938 +\\
772 772  )))|(((
773 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall vertical
940 +\\
774 774  )))
775 775  |(((
776 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:0
943 +\\
777 777  )))|(((
778 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel horizontal
945 +\\
779 779  )))
780 780  |(((
781 -FLASH.FEL/XGM.BPM/FL2.TUNNEL:1
948 +\\
782 782  )))|(((
783 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical
950 +\\
784 784  )))
785 785  |(((
786 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:1
953 +\\
787 787  )))|(((
788 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy aux tunnel
955 +\\
789 789  )))
790 790  |(((
791 -FLASH.FEL/XGM.INTENSITY/FL2.HALL
958 +\\
792 792  )))|(((
793 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
960 +\\
794 794  )))
795 795  |(((
796 -FLASH.FEL/XGM.INTENSITY/FL2.HALL:0
963 +\\
797 797  )))|(((
798 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
965 +\\
799 799  )))
800 800  |(((
801 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL
968 +\\
802 802  )))|(((
803 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
970 +\\
804 804  )))
805 805  |(((
806 -FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:0
973 +\\
807 807  )))|(((
808 -/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
975 +\\
809 809  )))
810 810  |(((
811 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042
978 +\\
812 812  )))|(((
813 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean phtoton energy
980 +\\
814 814  )))
815 815  |(((
816 -FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040
983 +\\
817 817  )))|(((
818 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelengt
985 +\\
819 819  )))
820 820  |(((
821 -FLASH.FEL/ADC.ADQ/OPIS1.CH02
988 +\\
822 822  )))|(((
823 -/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Raw data/CH02
990 +\\
824 824  )))
825 825  |(((
826 -FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2
993 +\\
827 827  )))|(((
828 -/FL2/Electron Diagnostic/Bunch charge/after undulator
995 +\\
829 829  )))
830 830  |(((
831 -FLASH.DIAG/PBD2.TOROID.ML/3GUN/CHARGE.FLASH2
998 +\\
832 832  )))|(((
833 -/FL2/Electron Diagnostic/Bunch charge/at gun
1000 +\\
834 834  )))
835 835  |(((
836 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR1.MOT1/FPOS
1003 +\\
837 837  )))|(((
838 -/FL2/Beamlines/Tunnel Apertures/position aperture1 horizontal
1005 +\\
839 839  )))
840 840  |(((
841 -FLASH.FEL/FL20T.PH.MOTOR/MOTOR2.MOT1/FPOS
1008 +\\
842 842  )))|(((
843 -/FL2/Beamlines/Tunnel Apertures/position aperture1 vertical
1010 +\\
844 844  )))
845 845  |(((
846 -FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER
1013 +\\
847 847  )))|(((
848 -/FL2/Beamlines/FL20/Shutter/channel 0
1015 +\\
849 849  )))
850 850  |(((
851 -FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00
1018 +\\
852 852  )))|(((
853 -/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD
1020 +\\
854 854  )))
855 855  |(((
856 -FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH00
1023 +\\
857 857  )))|(((
858 -/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH0/TD
1025 +\\
859 859  )))
860 860  |(((
861 861  FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD