Skip to Content

Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2026-01-19 14:35
From version 98.1
edited by sndueste
on 2025-05-19 17:23
Change comment: There is no comment for this version
To version 104.2
edited by sndueste
on 2025-12-15 13:12
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,6 +4,3 @@
1 -{{layout}}
2 -{{layout-section ac:type="single"}}
3 -{{layout-cell}}
4 4  == Contents ==
5 5  
6 6  
... ... @@ -61,25 +61,17 @@
61 61  {{/expand}}
62 62  
63 63  === HDF examples: ===
64 -{{/layout-cell}}
65 -{{/layout-section}}
66 66  
67 -{{layout-section ac:type="three_equal"}}
68 -{{layout-cell}}
69 69  * ADC data as example for **fast** **data** (10 Hz):            
70 70  
71 71  [[image:attach:image2020-11-16_15-26-28.png||height="250"]]
72 -{{/layout-cell}}
73 73  
74 -{{layout-cell}}
75 75  * The //average// FEL pulse energy as example for the **slow** **data**. Here the data is not saved with 10 Hz  - thus not for every FEL pulse train.  The data is typically saved with 1 Hz if the values are changing (like the FEL energy) and every about 20 sec if there is no change for longer time ( e.g. motor set values). Thus to use the data together with the "fast" one, one has to interpolate the data as explained in the examples in the repos below show (e.g. {{code language="none"}}df['GMD_T_average'] = df['GMD_T_average'].interpolate(method='linear'){{/code}})
76 76  
77 77   ( as example only every 10th train ID is listed in the HDF group "index")
78 78  
79 79  [[image:attach:image2020-11-16_15-31-45.png||height="250"]]
80 -{{/layout-cell}}
81 81  
82 -{{layout-cell}}
83 83  * (((
84 84  //zraw// group contains the **original DAQ (DOOCS) names**
85 85  )))
... ... @@ -88,11 +88,7 @@
88 88  
89 89  
90 90  [[image:attach:image2020-11-16_16-26-3.png||height="400"]]
91 -{{/layout-cell}}
92 -{{/layout-section}}
93 93  
94 -{{layout-section ac:type="single"}}
95 -{{layout-cell}}
96 96  {{info}}
97 97  === There are different options that help you to work with the FLASH HDF5 data in Python ===
98 98  
... ... @@ -99,11 +99,8 @@
99 99  * The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below
100 100  * and for smaller projects:  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
101 101  
102 -(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FS-FLASH USER tmp.Data Acquisition and controls 1.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FS-FLASH USER tmp.Data Acquisition and controls 1.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
87 +(% class="Object" %)See also the collection of Demo data and sample scripts : [[Collection of HDF5 sample data from different beamlines>>doc:FLASHUSER.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[DEMO - Working with FLASH data>>doc:FLASHUSER.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
103 103  {{/info}}
104 -{{/layout-cell}}
105 -{{/layout-section}}
106 -{{/layout}}
107 107  
108 108  
109 109  
... ... @@ -111,7 +111,7 @@
111 111  
112 112  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
113 113  
114 -== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
96 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (.raw) DAQ ==
115 115  
116 116  {{id name="DOOCSparameters"/}}
117 117  
... ... @@ -123,7 +123,7 @@
123 123  
124 124  The previously used naming scheme (2024 and before) can be found here:
125 125  
126 -{{expand expanded="false" title="FLASH1 Naming scheme used until 2024"}}
108 +{{expand expanded="false" title="FLASH1 naming scheme used until 2024"}}
127 127  ==== (% id="cke_bm_8853497S" style="display:none" %) (%%)Beamline info (FLASH1) ====
128 128  
129 129  {{code language="none"}}/FL1/Beamlines/Attenuator/pressure{{/code}}
... ... @@ -878,6 +878,8 @@
878 878  units :
879 879  
880 880  
863 +
864 +
881 881  If Opis is running typically on the the averaged data is saved. For several experiments it may make sense to save the information for each single bunch. This is up to now done by saving the complete ADC trace of the TOF setup. This is a huge amount of data and needs processing. This has to be performed after the beamtime in close contact to [[Markus Braune>>mailto:markus.braune@desy.de||shape="rect"]] ( responsible for [[OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]])
882 882  
883 883  
... ... @@ -909,19 +909,19 @@
909 909  (% style="color: rgb(94, 108, 132); font-weight: 600; letter-spacing: 0px;" %)
910 910  ===== undulator settings =====
911 911  
912 -{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
913 -DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
914 -DAQ channel:  {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
915 -desc: Set value for the anticipated wavelength . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ...
896 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength 1{{/code}}
897 +DOOCS prop : {{code language="none"}}FLASH.FEL/FL2.WAVELENGTHCONTROL/FLASH2.COLOR1/WAVELENGTH{{/code}}
898 +DAQ channel:  {{code language="none"}}FLASH.FEL/FL2.WAVELENGTHCONTROL/FLASH2.COLOR1/WAVELENGTH{{/code}}
899 +desc: Set value for the anticipated wavelength 1 . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ... For 2 color operation there is also  the same parameter for COLOR 2
916 916  units: nm
917 917  
918 -{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE14 gap{{/code}}
919 -DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
920 -DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
921 -desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
902 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE13 gap{{/code}}
903 +DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE13/GAP{{/code}}
904 +DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE13/GAP{{/code}}
905 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper. 
922 922  units: mm
923 923  
924 -The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
908 +The gap values are saved for all 12 undulators (Nr 2 to 13). Undulator 13 is the one closest to the experimental hall.
925 925  
926 926  =====
927 927  arrival time (BAM) =====
... ... @@ -1205,7 +1205,7 @@
1205 1205  
1206 1206  {{view-file att--filename="FSLADAQ-DAQParameterlistFL24-2.pdf"}}{{/view-file}}
1207 1207  
1208 -
1192 +internal link to parameter list: [[FS-LA DAQ - XWiki>>url:https://xwiki.desy.de/xwiki/bin/view/FSLADAQ/]]
1209 1209  {{/info}}
1210 1210  
1211 1211  {{expand title="Laser parameters used until 2023"}}