Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 47.1
edited by sndueste
on 2021/02/10 10:14
Change comment: There is no comment for this version
To version 54.1
edited by sndueste
on 2022/01/14 09:44
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -19,6 +19,12 @@
19 19  {{code language="none"}}> module load xray{{/code}}
20 20  {{code language="none"}}> hdfview{{/code}}
21 21  
22 +or you can use
23 +
24 +{{code language="none"}}> silx view{{/code}}
25 +
26 +\\
27 +
22 22  [[Contents>>doc:||anchor="Contents"]]
23 23  
24 24  == The FLASH HDF5 format ==
... ... @@ -97,12 +97,12 @@
97 97  
98 98  {{layout-section ac:type="single"}}
99 99  {{layout-cell}}
100 -{{info title="Sample scripts in python"}}
106 +{{info}}
101 101  === Reference implementation (Python) ===
102 102  
103 -[[~[~[image:attach:binder_badge.png~|~|thumbnail="true" width="120"~]~]>>url:https://mybinder.org/v2/git/https%3A%2F%2Fgitlab.desy.de%2Fchristopher.passow%2Fflash-daq-hdf/master||shape="rect"]]
109 +(imperative)  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
104 104  
105 -(% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
111 +(% class="Object" %)(object oriented) [[https:~~/~~/gitlab.desy.de/christopher.passow/fdh-builder>>url:https://gitlab.desy.de/christopher.passow/fdh-builder.git||shape="rect"]]
106 106  {{/info}}
107 107  {{/layout-cell}}
108 108  {{/layout-section}}
... ... @@ -202,6 +202,7 @@
202 202  
203 203  \\
204 204  
211 +{{expand title="GMD format untill 2021"}}
205 205  (% style="color: rgb(0,0,0);" %)**Discontinued GMD data recording / evaluation  (VME + PhotonFlux ML server)**
206 206  
207 207  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
... ... @@ -249,9 +249,12 @@
249 249  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
250 250  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
251 251  units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
259 +{{/expand}}
252 252  
253 253  \\
254 254  
263 +\\
264 +
255 255  (% style="color: rgb(0,0,0);" %)**NEW (2021) GMD data recording / evaluation  (MTCA, analog to FLASH2 and XFEL)**
256 256  
257 257  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
... ... @@ -528,7 +528,7 @@
528 528  //always saved (PBD)//
529 529  DOOCS prop : {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP/CHARGE.TD{{/code}}
530 530  DAQ channel: {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP{{/code}}
531 -desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH1)
541 +desc: The bunch pattern as function of time in a burst recorded by toroid diagnostic BEHIND the undulator. (FLASH1)
532 532  units:
533 533  \\
534 534  
... ... @@ -601,7 +601,7 @@
601 601  //always saved (PBD)//
602 602  DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}}
603 603  DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}}
604 -desc: delaytime between the optical laser and the FEL units: ps
614 +desc: delay time between the optical laser and the FEL units: ps
605 605  
606 606  \\
607 607  
... ... @@ -611,7 +611,7 @@
611 611  
612 612  ==== User Data (FLASH1) ====
613 613  
614 -The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
624 +The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring of slow properties (motor positions etc) for user experiments. For details please ask your local contact.
615 615  
616 616  NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
617 617  
... ... @@ -639,13 +639,13 @@
639 639  {{code language="none"}}/FL1/Experiment/BL3/ADQ412 GHz ADC/CH03/TD{{/code}}
640 640  
641 641  DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
642 -here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
652 +here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} contains only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferably.
643 643  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}}
644 644  
645 645  In addition there are also additional parameters saved like:
646 646  
647 647  * {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
648 -* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
658 +* {{code language="none"}}number of samples{{/code}}: total number of samples recorded for each 10 Hz trigger
649 649  * {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
650 650  
651 651  ===== MHz ADCs =====
... ... @@ -658,7 +658,7 @@
658 658  In addition there are also additional parameters saved like:
659 659  
660 660  * {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
661 -* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
671 +* {{code language="none"}}number of samples{{/code}}: total number of samples recorded for each 10 Hz trigger
662 662  
663 663  [[Contents>>doc:||anchor="Contents"]]
664 664  
... ... @@ -819,7 +819,7 @@
819 819  // saved opon request (PBD2)//
820 820  DOOCS prop : {{code language="none"}}FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
821 821  DAQ channel:{{code language="none"}} FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040{{/code}}
822 -desc : meanwavelength ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
832 +desc : mean wavelength ( ~~ 1 sec averaging time ) measured in the TUNNEL for a specific bunch out of the bunch train (via photoelectron spectroscopy)
823 823  units : nm
824 824  
825 825  \\
... ... @@ -833,11 +833,11 @@
833 833  
834 834  \\
835 835  
836 -If Opis is running typically on the the averaged data is saved. For several experiments it may make sense to save the information for each single bunch. This is up to now done by savng the compleate ADC trace of the TOF setup. This is a huge amount of data and needs processing. This has to be performed after the beamtime in close contact to [[Markus Braune>>mailto:markus.braune@desy.de||shape="rect"]] ( respobsible for [[OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]])
846 +If Opis is running typically on the the averaged data is saved. For several experiments it may make sense to save the information for each single bunch. This is up to now done by saving the complete ADC trace of the TOF setup. This is a huge amount of data and needs processing. This has to be performed after the beamtime in close contact to [[Markus Braune>>mailto:markus.braune@desy.de||shape="rect"]] ( responsible for [[OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]])
837 837  
838 838  \\
839 839  
840 -In case OPIS was not operating there is still informaton about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
850 +In case OPIS was not operating there is still information about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
841 841  
842 842  \\
843 843  
... ... @@ -856,8 +856,21 @@
856 856  
857 857  \\
858 858  
859 -===== undulator settings =====
869 +===== electron bunch energy =====
860 860  
871 +{{code language="none"}}/FL2/Electron Diagnostic/Electron energy/energy of first bunch/behind undulators{{/code}}
872 +//always saved (PBD2)//
873 +DOOCS prop : {{code language="none"}}FLASH.DIAG/BEAM_ENERGY_MEASUREMENT/FL2XTDS/ENERGY.FLASH2{{/code}}
874 +DAQ channel: (% style="color: rgb(94,108,132);" %)TTF2.DAQ/PBD2.BEAM.ENERGY.MEAS.ML.COPY/FL2XTDS.ENERGY.FLASH2{{code language="none"}}{{/code}}(%%)
875 +desc: electron bunch energy measured behind the undulator. Data is saved with 10 Hz - BUT (for computation reasons) only the energy of the FIRST bunch is recorded. The data is also available for (% style="color: rgb(94,108,132);" %)extraction and septum  in the beginning of FLASH2
876 +
877 +(% style="letter-spacing: 0.0px;" %)units: (% class="twikiNewLink" %)MeV
878 +
879 +\\
880 +
881 +(% style="color: rgb(94,108,132);font-weight: 600;letter-spacing: 0.0px;" %)
882 +undulator settings
883 +
861 861  {{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
862 862  //always saved (PBD2)//
863 863  DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}