Skip to Content

Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025-11-19 14:51
From version 98.1
edited by sndueste
on 2025-05-19 17:23
Change comment: There is no comment for this version
To version 104.1
edited by sndueste
on 2025-11-19 14:51
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,6 +4,3 @@
1 -{{layout}}
2 -{{layout-section ac:type="single"}}
3 -{{layout-cell}}
4 4  == Contents ==
5 5  
6 6  
... ... @@ -61,25 +61,17 @@
61 61  {{/expand}}
62 62  
63 63  === HDF examples: ===
64 -{{/layout-cell}}
65 -{{/layout-section}}
66 66  
67 -{{layout-section ac:type="three_equal"}}
68 -{{layout-cell}}
69 69  * ADC data as example for **fast** **data** (10 Hz):            
70 70  
71 71  [[image:attach:image2020-11-16_15-26-28.png||height="250"]]
72 -{{/layout-cell}}
73 73  
74 -{{layout-cell}}
75 75  * The //average// FEL pulse energy as example for the **slow** **data**. Here the data is not saved with 10 Hz  - thus not for every FEL pulse train.  The data is typically saved with 1 Hz if the values are changing (like the FEL energy) and every about 20 sec if there is no change for longer time ( e.g. motor set values). Thus to use the data together with the "fast" one, one has to interpolate the data as explained in the examples in the repos below show (e.g. {{code language="none"}}df['GMD_T_average'] = df['GMD_T_average'].interpolate(method='linear'){{/code}})
76 76  
77 77   ( as example only every 10th train ID is listed in the HDF group "index")
78 78  
79 79  [[image:attach:image2020-11-16_15-31-45.png||height="250"]]
80 -{{/layout-cell}}
81 81  
82 -{{layout-cell}}
83 83  * (((
84 84  //zraw// group contains the **original DAQ (DOOCS) names**
85 85  )))
... ... @@ -88,11 +88,7 @@
88 88  
89 89  
90 90  [[image:attach:image2020-11-16_16-26-3.png||height="400"]]
91 -{{/layout-cell}}
92 -{{/layout-section}}
93 93  
94 -{{layout-section ac:type="single"}}
95 -{{layout-cell}}
96 96  {{info}}
97 97  === There are different options that help you to work with the FLASH HDF5 data in Python ===
98 98  
... ... @@ -99,11 +99,8 @@
99 99  * The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below
100 100  * and for smaller projects:  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
101 101  
102 -(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FS-FLASH USER tmp.Data Acquisition and controls 1.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FS-FLASH USER tmp.Data Acquisition and controls 1.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
87 +(% class="Object" %)See also the collection of Demo data and sample scripts : [[Collection of HDF5 sample data from different beamlines>>doc:FLASHUSER.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[DEMO - Working with FLASH data>>doc:FLASHUSER.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
103 103  {{/info}}
104 -{{/layout-cell}}
105 -{{/layout-section}}
106 -{{/layout}}
107 107  
108 108  
109 109  
... ... @@ -111,7 +111,7 @@
111 111  
112 112  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
113 113  
114 -== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
96 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (.raw) DAQ ==
115 115  
116 116  {{id name="DOOCSparameters"/}}
117 117  
... ... @@ -123,7 +123,7 @@
123 123  
124 124  The previously used naming scheme (2024 and before) can be found here:
125 125  
126 -{{expand expanded="false" title="FLASH1 Naming scheme used until 2024"}}
108 +{{expand expanded="false" title="FLASH1 naming scheme used until 2024"}}
127 127  ==== (% id="cke_bm_8853497S" style="display:none" %) (%%)Beamline info (FLASH1) ====
128 128  
129 129  {{code language="none"}}/FL1/Beamlines/Attenuator/pressure{{/code}}
... ... @@ -909,19 +909,19 @@
909 909  (% style="color: rgb(94, 108, 132); font-weight: 600; letter-spacing: 0px;" %)
910 910  ===== undulator settings =====
911 911  
912 -{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
913 -DOOCS prop : {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
914 -DAQ channel:  {{code language="none"}}TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH{{/code}}
915 -desc: Set value for the anticipated wavelength . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ...
894 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength 1{{/code}}
895 +DOOCS prop : {{code language="none"}}FLASH.FEL/FL2.WAVELENGTHCONTROL/FLASH2.COLOR1/WAVELENGTH{{/code}}
896 +DAQ channel:  {{code language="none"}}FLASH.FEL/FL2.WAVELENGTHCONTROL/FLASH2.COLOR1/WAVELENGTH{{/code}}
897 +desc: Set value for the anticipated wavelength 1 . This parameter is used to set the undulator gap. It may however deviate from the actual wavelength by several % ... For 2 color operation there is also  the same parameter for COLOR 2
916 916  units: nm
917 917  
918 -{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE14 gap{{/code}}
919 -DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
920 -DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
921 -desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
900 +{{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/SASE13 gap{{/code}}
901 +DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE13/GAP{{/code}}
902 +DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE13/GAP{{/code}}
903 +desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper. 
922 922  units: mm
923 923  
924 -The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
906 +The gap values are saved for all 12 undulators (Nr 2 to 13). Undulator 13 is the one closest to the experimental hall.
925 925  
926 926  =====
927 927  arrival time (BAM) =====
... ... @@ -1205,7 +1205,7 @@
1205 1205  
1206 1206  {{view-file att--filename="FSLADAQ-DAQParameterlistFL24-2.pdf"}}{{/view-file}}
1207 1207  
1208 -
1190 +internal link to parameter list: [[FS-LA DAQ - XWiki>>url:https://xwiki.desy.de/xwiki/bin/view/FSLADAQ/]]
1209 1209  {{/info}}
1210 1210  
1211 1211  {{expand title="Laser parameters used until 2023"}}