Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 35.1
edited by sndueste
on 2020/11/16 10:19
Change comment: There is no comment for this version
To version 39.1
edited by sndueste
on 2021/02/09 11:53
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -56,7 +56,7 @@
56 56  
57 57  == The new (starting 2021) HDF5 format ==
58 58  
59 -Here is some documentation on the changes of the HDF5 format that well be avaliable in 2021 (work in progress)
59 +Here is [[some documentation on the changes of the HDF5 format>>doc:FLASHUSER.HDF5 format]] that well be available in 2021 (work in progress)
60 60  
61 61  \\
62 62  
... ... @@ -151,12 +151,14 @@
151 151  
152 152  \\
153 153  
154 -==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) / Spectrometer (FLASH1) ====
154 +==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) ====
155 155  
156 +\\
157 +
158 +(% style="color: rgb(0,0,0);" %)**Discontinued GMD data recording / evaluation  (VME + PhotonFlux ML server)**
159 +
156 156  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
157 -//always saved (PBD)//
158 -(% style="color: rgb(165,173,186);" %)New MTCA Version: DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
159 -(% style="color: rgb(165,173,186);" %)New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
161 +//always saved (PBD)//\\
160 160  
161 161  (% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} (%%)
162 162  (% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}(%%)
... ... @@ -166,9 +166,6 @@
166 166  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
167 167  //always saved (PBD)//
168 168  
169 -(% style="color: rgb(193,199,208);" %)New MTCA Version: DOOCS prop : 
170 -{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
171 -
172 172  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
173 173  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
174 174  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
... ... @@ -184,9 +184,6 @@
184 184  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
185 185  //always saved (PBD)//
186 186  
187 -(% style="color: rgb(165,173,186);" %)New MTCA Version: DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.BDA/PHOTONFLUX.UJ{{/code}} (%%)
188 -(% style="color: rgb(165,173,186);" %)New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.BDA/PHOTONFLUX.UJ{{/code}}
189 -
190 190  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT05/VAL{{/code}}
191 191  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENPULSEIC{{/code}}
192 192  desc : calibrated average SASE Energy/pulse measured in the BDA (in the experimental hall) after the attenuator (ion current)
... ... @@ -195,8 +195,6 @@
195 195  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA{{/code}}
196 196  //always saved (PBD)//
197 197  
198 -(% style="color: rgb(193,199,208);" %)New MTCA Version: DOOCS prop : 
199 -{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.BDA/INTENSITY.TD{{/code}}New MTCA Version: DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.BDA/INTENSITY.TD{{/code}}(%%)
200 200  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
201 201  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
202 202  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
... ... @@ -211,6 +211,55 @@
211 211  
212 212  \\
213 213  
208 +(% style="color: rgb(0,0,0);" %)**NEW (2021) GMD data recording / evaluation  (MTCA, analog to FLASH2 and XFEL)**
209 +
210 +{{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
211 +//always saved (PBD)//
212 +(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
213 +(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
214 +
215 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator
216 +units : microJ
217 +
218 +\\
219 +
220 +{{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
221 +//always saved (PBD)//
222 +
223 +(% style="color: rgb(0,0,0);" %)DOOCS prop : 
224 +{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
225 +
226 +desc : Energy per pulse measured in the Tunnel.  In addition measurement errors and beam position are included for EACH pulse in the pulse train  !! (see below)
227 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
228 +
229 +{{info title="GMD pulse resolved data structure"}}
230 +For every pulse in the pulse train the information is saved:
231 +
232 +
233 +1. **Intensity per pulse** (a.u. (more or less µJ ))
234 +1. Intensity per pulse (auxillary GMD) - not used
235 +1. Position horizontal (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
236 +1. Position vertical (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
237 +1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%))
238 +1. Position horizontal sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
239 +1. Position vertical sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
240 +1. Combined warning and error flags
241 +
242 +The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 
243 +file
244 +
245 +
246 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]]
247 +
248 +\\
249 +{{/info}}
250 +
251 +All values for the GMD are also available for the** BDA GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between BDA and Tunnel signal shows the attenuation. **BUT NOTE** that the filter units  are downstream the GMD. So if filters  are used this influence is NOT measured by the GMD BDA !
252 +
253 +\\
254 +
255 +Besides  pulse energy the GMD also provides information about the beam position
256 +
214 214  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
215 215  //always saved (PBD)//
216 216  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
... ... @@ -239,6 +239,10 @@
239 239  desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical)
240 240  units : mm
241 241  
285 +\\
286 +
287 +==== Spectrometer (FLASH1) ====
288 +
242 242  {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}}
243 243  _always saved (when Spectrum is measured !!) (PBD) _
244 244  DOOCS prop : {{code language="none"}}TTF2.EXP/PHOTONWL.ML/WAVE_LENGTH/VAL.TD{{/code}}
... ... @@ -630,40 +630,37 @@
630 630  
631 631  \\
632 632  
633 -(% style="color: rgb(255,204,0);" %)average Sigma    to be included in
634 -
635 -(% style="color: rgb(193,199,208);" %){{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel uncertainty{{/code}} (%%)
636 -(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%)
637 -(% style="color: rgb(193,199,208);" %)DOOCS prop : FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%)
638 -(% style="color: rgb(193,199,208);" %)DAQ channel: FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%)
639 -(% style="color: rgb(193,199,208);" %)desc :  This parameter gives an indication of the error of the measurement of the average pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)
640 -(% style="color: rgb(193,199,208);" %)units : microJ
641 -
642 -\\
643 -
644 -\\
645 -
646 646  {{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
647 647  //always saved (PBD2)//
648 648  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
649 649  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
650 -desc : Energy per pulse measured in the Tunnel  (in fromt of the gas attenuator and the apertures in the Hall)
684 +desc : Energy per pulse measured in the Tunnel  (in front of the gas attenuator and the apertures in the Hall) In addition measurement errors and beam position are included for EACH pulse in the pulse train  !! (see below)
651 651  units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
652 652  
653 -\\
687 +{{info title="GMD pulse resolved data structure"}}
688 +For every pulse in the pulse train the information is saved:
689 +
654 654  
655 -\\
691 +1. **Intensity per pulse** (a.u. (more or less µJ ))
692 +1. Intensity per pulse (auxillary GMD) - not used
693 +1. Position horizontal (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
694 +1. Position vertical (mm, for a single pulse the position information may be very noisy  - talk to your local contact)
695 +1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%))
696 +1. Position horizontal sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
697 +1. Position vertical sigma  (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise)
698 +1. Combined warning and error flags
656 656  
657 -{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel uncertainty (sigma){{/code}}
658 -//always saved (PBD2)//
659 -DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.SIGMA.TD{{/code}}
660 -DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:4{{/code}}
661 -desc :(% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise,  detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)
662 -units : a.u. (more or less µJ - related to the value of the pulse energy )
700 +The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 
701 +file
663 663  
703 +
704 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]]
664 664  
665 -{{code language="none"}}{{/code}}
706 +\\
707 +{{/info}}
666 666  
709 +\\
710 +
667 667  All values for the GMD are also available for the** HALL GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between Hall and Tunnel signal shows the attenuation. **BUT NOTE** that the filter unit and the Aperture 4 are downstream the GMD. So if filters and aperture are used this influence is NOT measured by the GMD hall !
668 668  
669 669  \\
... ... @@ -1150,10 +1150,6 @@
1150 1150  
1151 1151  [[Contents>>doc:||anchor="Contents"]]
1152 1152  
1153 -=== How to read HDF5 with Python via FLASHH5 ===
1154 -
1155 -With [[FlashH5>>doc:FLASHUSER.FLASHH5 for easier access of FLASH's HDF5 files]] we provide h5py based examples to access and evaluate FLASH's HDF5 files.
1156 -
1157 1157  \\
1158 1158  
1159 1159  == HDF5 and DOOCS ==