Changes for page The FLASH HDF5 structure
Last modified by sndueste on 2025/02/06 10:55
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -8,9 +8,9 @@ 8 8 9 9 == General information about HDF5 == 10 10 11 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https:// portal.hdfgroup.org/display/support||shape="rect"]]11 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://www.hdfgroup.org/HDF5/||shape="rect"]] 12 12 13 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://port al.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]13 +To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://support.hdfgroup.org/products/java/hdfview/index.html||shape="rect"]] 14 14 15 15 For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module : 16 16 {{code language="none"}}> module load xray{{/code}} ... ... @@ -18,94 +18,26 @@ 18 18 19 19 [[Contents>>doc:||anchor="Contents"]] 20 20 21 -== Thenew (starting 2021)HDF5format ==21 +== FLASH HDF5 structure == 22 22 23 - \\23 +The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organised according to train IDs. The general structure is: 24 24 25 -FLASH provides a conversion of its data acquisition (DAQ) to the commonly used [[HDF5>>url:https://www.hdfgroup.org/solutions/hdf5/||shape="rect"]] format. Correlated data are mapped by a primary index called **train ID**. Every data set has an individual index of train IDs to identify the data even when data are missing or deviate in update rate.If the data set of choice contains gaps, users have to decide how to treat missing values. DAQ channels are spread across various files with one file name pattern for each DAQ. This means users have to assemble data from different files if necessary. 26 - 27 -The hierarchy is realized using a human readable named HDF tree with each DAQ channel containing the data sets "//value//" and "//index//". Additionally, the HDF group //zraw// contains a tree of the original DAQ channel names. 28 - 29 -Reference implementation, which follows the concept of Python libraries like Pandas, Xarray, or Dask, is given below. 30 - 31 -\\ 32 - 33 -{{expand title="Discontinued HDF formats"}} 34 -== Comparison to FLASH's deprecated HDF formats == 35 - 36 -Before 2021, FLASH provided two different HDF formats formally known as //near-online// and //offline// HDF files. 37 - 38 -All data sets were aligned by the same global index by filling in missing data. Fast DAQ channels (pulse synchronous data - update 10 Hz) are filled in by NaN or 0, slow channels (not pulse synchronous data - update e.g. 1 Hz ) are interpolated by the DAQs libraries, by keeping the value constant up to the next change. 39 - 40 -While the near-online HDF files were converted live during the beamtime, the offline HDF files were manually compiled weeks/months later. Near-online HDF files were used by a provided API [[BeamtimeDaqAccess>>url:https://confluence.desy.de/display/FLASHUSER/Near-Online+data+analysis#Near-Onlinedataanalysis-BriefUserGuidetoBeamtimeDAQAccess||shape="rect"]], which also searches for DAQ channels in files. With assembled files "by run", all DAQ channels were existing in the same HDF file. While shorter runs usually fitted into one file, longer runs still had to be aggregated over several files. The creation of the assembled type of files still involves the use of fairly unstable DAQ Mex-functions As the environment required for using the Mex-functions is already deprecated, its continued existence is uncertain. 41 - 42 -The HDF hierarchy is almost identical in all formats. While in the the recent format each DAQ channel contains the data sets "value" and "index", the deprecated format had one data set for each DAQ channel. The deprecated formats supplies no time axis parameters for spectra data types. 43 -{{/expand}} 44 - 45 -== HDF excerpt: == 46 - 47 -\\ 48 - 49 -ADC data as example for **fast** **data** (10 Hz): 50 - 51 -\\ 52 - 53 -[[image:attach:image2020-11-16_15-26-28.png||height="250"]] 54 - 55 -\\ 56 - 57 -{{info title="Sample scripts in python"}} 58 -== Reference implementation (Python) == 59 - 60 -[[~[~[image:attach:binder_badge.png~|~|thumbnail="true" width="120"~]~]>>url:https://mybinder.org/v2/git/https%3A%2F%2Fgitlab.desy.de%2Fchristopher.passow%2Fflash-daq-hdf/master||shape="rect"]] 61 - 62 -(% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]] 63 -{{/info}} 64 - 65 -\\ 66 - 67 -\\ 68 - 69 -== The discontinued (till 2021) FLASH HDF5 structure == 70 - 71 -The photon diagnostic, electron diagnostic and beamline information as well as the information about the pump-probe laser and the infrastructure offered for users (GHz/MHz ADCs) can be included in one HDF5 file which is organized according to train IDs. The general structure is: 72 - 73 73 * Electron Diagnostic 74 74 * Photon Diagnostics 75 75 * Beamlines 76 76 * Experiment 77 77 * Timing 78 -[[image: attach:HDF5_structure.jpg||height="400"]]30 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg~|~|alt="HDF5_structure.jpg" width="700" height="500"~]~]>>attach:HDF5_structure.jpg]] 79 79 80 -A detailed description of (most) channels can be found in the lower part of the hdf5 viewer: 81 -[[image: attach:HDF5_structure_desc.jpg||thumbnail="true" height="250"]]32 +A detailled description of (most) channels can be found in the lower part of the hdf5 viewer: 33 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg~|~|alt="HDF5_structure_desc.jpg" width="341" height="413"~]~]>>attach:HDF5_structure_desc.jpg]] 82 82 83 83 [[Contents>>doc:||anchor="Contents"]] 84 84 85 85 \\ 86 86 87 -== =HDF5examplefiles ===39 +== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ == 88 88 89 -Here we have a few HDF5 samples (User data combined with Photon diagnostics data) from a few beamtimes showing the different kind options. 90 - 91 -[[image:attach:image2019-10-21_17-2-50.png||thumbnail="true" width="300"]] [[download HDF5 (Images @ FL2)>>url:https://desycloud.desy.de/index.php/s/nyEgeCWJFC4gao2||shape="rect"]] 92 - 93 -\\ 94 - 95 -[[~[~[image:attach:image2019-10-22_10-52-27.png~|~|thumbnail="true" width="300"~]~]download HDF5 (GHz ADC and OPIS @ FL2)>>url:https://desycloud.desy.de/index.php/s/AeA2kPNNnZgX95A||shape="rect"]] 96 - 97 -\\ 98 - 99 -\\ 100 - 101 -[[Contents>>doc:||anchor="Contents"]] 102 - 103 -\\ 104 - 105 -== Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ == 106 - 107 -{{id name="DOOCSparameters"/}} 108 - 109 109 The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]]. 110 110 The most common and often used ones are summarized below: 111 111 ... ... @@ -147,7 +147,7 @@ 147 147 //always saved (PBD)// 148 148 DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}} 149 149 DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}} 150 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH USER.jddd-linked help pages.Filter-Units.Filtersin FLASH1and FLASH2.WebHome]]82 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]] 151 151 units: degree 152 152 \\ 153 153 ... ... @@ -155,7 +155,7 @@ 155 155 //always saved (PBD)// 156 156 DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}} 157 157 DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}} 158 -desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH USER.jddd-linked help pages.Filter-Units.Filtersin FLASH1and FLASH2.WebHome]]90 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]] 159 159 units: degree 160 160 \\ 161 161 ... ... @@ -185,33 +185,27 @@ 185 185 \\ 186 186 187 187 188 -NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. For more Info contact your local contact120 +NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact 189 189 190 190 [[Contents>>doc:||anchor="Contents"]] 191 191 192 192 \\ 193 193 194 -==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) ==== 126 +==== Photon Diagnostics SASE ([[GMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]]) / Spectrometer (FLASH1) ==== 195 195 196 -\\ 197 - 198 -(% style="color: rgb(0,0,0);" %)**Discontinued GMD data recording / evaluation (VME + PhotonFlux ML server)** 199 - 200 200 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}} 201 -//always saved (PBD)// 202 - 203 -(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} (%%) 204 -(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}}(%%) 205 -desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator (ion current) 129 +//always saved (PBD)// 130 +DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT04/VAL{{/code}} 131 +DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENPULSEIC{{/code}} 132 +desc : calibrated average SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current) 206 206 units : microJ 207 207 208 208 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}} 209 -//always saved (PBD)// 210 - 136 +//always saved (PBD)// 211 211 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}} 212 212 DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}} 213 213 desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL 214 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH USER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**140 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]** 215 215 216 216 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}} 217 217 //always saved (PBD)// ... ... @@ -218,11 +218,10 @@ 218 218 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}} 219 219 DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}} 220 220 desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise 221 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH USER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**147 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]** 222 222 223 223 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}} 224 -//always saved (PBD)// 225 - 150 +//always saved (PBD)// 226 226 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT05/VAL{{/code}} 227 227 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENPULSEIC{{/code}} 228 228 desc : calibrated average SASE Energy/pulse measured in the BDA (in the experimental hall) after the attenuator (ion current) ... ... @@ -229,12 +229,11 @@ 229 229 units : microJ 230 230 231 231 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA{{/code}} 232 -//always saved (PBD)// 233 - 157 +//always saved (PBD)// 234 234 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}} 235 235 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}} 236 236 desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL 237 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH USER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**161 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]** 238 238 239 239 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}} 240 240 //always saved (PBD)// ... ... @@ -241,59 +241,8 @@ 241 241 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}} 242 242 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}} 243 243 desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise 244 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH USER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**168 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]** 245 245 246 -\\ 247 - 248 -(% style="color: rgb(0,0,0);" %)**NEW (2021) GMD data recording / evaluation (MTCA, analog to FLASH2 and XFEL)** 249 - 250 -{{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}} 251 -//always saved (PBD)// 252 -(% style="color: rgb(0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%) 253 -(% style="color: rgb(0,0,0);" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} 254 - 255 -desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator 256 -units : microJ 257 - 258 -\\ 259 - 260 -{{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}} 261 -//always saved (PBD)// 262 - 263 -(% style="color: rgb(0,0,0);" %)DOOCS prop : 264 -{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}} 265 - 266 -desc : Energy per pulse measured in the Tunnel. In addition measurement errors and beam position are included for EACH pulse in the pulse train !! (see below) 267 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]** 268 - 269 -{{info title="GMD pulse resolved data structure"}} 270 -For every pulse in the pulse train the information is saved: 271 - 272 - 273 -1. **Intensity per pulse** (a.u. (more or less µJ )) 274 -1. Intensity per pulse (auxillary GMD) - not used 275 -1. Position horizontal (mm, for a single pulse the position information may be very noisy - talk to your local contact) 276 -1. Position vertical (mm, for a single pulse the position information may be very noisy - talk to your local contact) 277 -1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)) 278 -1. Position horizontal sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 279 -1. Position vertical sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 280 -1. Combined warning and error flags 281 - 282 -The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 283 -file 284 - 285 - 286 -[[image:attach:image2021-2-9_10-51-6.png||height="250"]] 287 - 288 -\\ 289 -{{/info}} 290 - 291 -All values for the GMD are also available for the** BDA GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between BDA and Tunnel signal shows the attenuation. **BUT NOTE** that the filter units are downstream the GMD. So if filters are used this influence is NOT measured by the GMD BDA ! 292 - 293 -\\ 294 - 295 -Besides pulse energy the GMD also provides information about the beam position 296 - 297 297 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}} 298 298 //always saved (PBD)// 299 299 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}} ... ... @@ -322,10 +322,6 @@ 322 322 desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical) 323 323 units : mm 324 324 325 -\\ 326 - 327 -==== Spectrometer (FLASH1) ==== 328 - 329 329 {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}} 330 330 _always saved (when Spectrum is measured !!) (PBD) _ 331 331 DOOCS prop : {{code language="none"}}TTF2.EXP/PHOTONWL.ML/WAVE_LENGTH/VAL.TD{{/code}} ... ... @@ -409,25 +409,10 @@ 409 409 //always saved (PBD)// 410 410 DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}} 411 411 DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}} 412 -desc: Electron bunch arrival time measured with the BAM inside the accelerator - however shows a very good correlation to the arrivaltime of the XUV pulses in the experiment (pulse resolved data). 413 -units: ps (bigger numbers indicate later arrivaltime of the electrons) 281 +desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data) 282 +units: ps (bigger numbers indicate later arrivaltime of the electrons) 283 +note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]] 414 414 415 -{{code language="none"}}/FL1/Electron Diagnostic/BAM/1SFELC/electron bunch arrival time (low charge){{/code}} 416 -//always saved (PBD)// 417 -DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/1SFELC/LOW_CHARGE_ARRIVAL_TIME{{/code}} 418 -DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/1SFELC.LOW_CHARGE_ARRIVAL_TIME{{/code}} 419 -desc: Electron bunch arrival time measured with the BAM before the undulator (pulse resolved data). This one was newly installed in 2020. 420 -units: ps (bigger numbers indicate later arrivaltime of the electrons) 421 - 422 -{{info title="BAM hints"}} 423 -* besides the arrivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved.In case of doubt ask your local contact 424 -* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]] 425 -* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] 426 -* a recent [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]] 427 -{{/info}} 428 - 429 -\\ 430 - 431 431 ===== electron beam profile ===== 432 432 433 433 {{code language="none"}}/FL1/Electron Diagnostic/Electron bunch profile/TDS profile{{/code}} ... ... @@ -456,7 +456,7 @@ 456 456 ===== electron bunch energy ===== 457 457 458 458 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/average electron energy{{/code}} 459 - //always saved (PBD)//313 +_always saved (PBD) 460 460 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_INTRA_MEAN/VAL{{/code}} 461 461 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_MEAN{{/code}} 462 462 desc: electron bunch energy (average over the bunch train) ... ... @@ -464,7 +464,7 @@ 464 464 \\ 465 465 466 466 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/pulse resolved energy{{/code}} 467 - //always saved (PBD)//321 +_always saved (PBD) 468 468 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_SPECT/VAL.TD{{/code}} 469 469 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_SPECT{{/code}} 470 470 desc: electron bunch energy bunch resolved ... ... @@ -473,7 +473,7 @@ 473 473 \\ 474 474 475 475 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/wavelength bunch train average{{/code}} 476 - //always saved (PBD)//330 +_always saved (PBD) 477 477 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/LAMBDA_MEAN/VAL{{/code}} 478 478 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/LAMBDA_MEAN{{/code}} 479 479 desc: Wavelength calculated by the electron bunch energy (average over the bunch train) (FLASH1) ... ... @@ -667,12 +667,12 @@ 667 667 668 668 ==== Beamline info (FLASH2) ==== 669 669 670 -{{code language="none"}}/FL2/Beamlines/Attenuator/pressure Â{{/code}}671 -(% style="color: rgb( 0,0,0);" %)//always saved (PBD2)// (%%)672 -(% style="color: rgb( 0,0,0);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)673 -(% style="color: rgb( 0,0,0);" %)DAQ channel: {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)674 -(% style="color: rgb( 0,0,0);" %)desc: set pressure in the gas attenuator (%%)675 -(% style="color: rgb( 0,0,0);" %)units: mbar(%%)524 +(% style="color: rgb(255,153,0);" %)(not yet available){{code language="none"}}/FL2/Beamlines/Attenuator/pressure {{/code}}(%%) 525 +(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%) 526 +(% style="color: rgb(193,199,208);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%) 527 +(% style="color: rgb(193,199,208);" %)DAQ channel: {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%) 528 +(% style="color: rgb(193,199,208);" %)desc: set pressure in the gas attenuator (%%) 529 +(% style="color: rgb(193,199,208);" %)units: mbar(%%) 676 676 \\ 677 677 678 678 {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}} ... ... @@ -687,17 +687,15 @@ 687 687 //always saved (PBD2)// 688 688 DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}} 689 689 DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS 690 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASH USER.jddd-linked help pages.Filter-Units.Filtersin FLASH1and FLASH2.WebHome]]**544 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]** 691 691 units: degree 692 692 \\ 693 693 694 -/FL2/Beamlines/Filter wheel/position wheel 2 695 -always saved (PBD2) 696 -DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}} 697 -DAQ channel: {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}} 698 -desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]] 699 -units: degree 700 700 549 +//always saved (PBD2)// 550 +\\\\**[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]** 551 +{{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2 DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}} 552 + 701 701 \\ 702 702 703 703 NOTE: Aperture positions in the beamline as well as the positions of the beam steering mirrors are also saved. for more Info contact your local contact ... ... @@ -719,37 +719,40 @@ 719 719 720 720 \\ 721 721 574 +(% style="color: rgb(255,204,0);" %)average Sigma   to be included in 575 + 576 +(% style="color: rgb(193,199,208);" %){{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel uncertainty{{/code}} (%%) 577 +(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%) 578 +(% style="color: rgb(193,199,208);" %)DOOCS prop : FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%) 579 +(% style="color: rgb(193,199,208);" %)DAQ channel: FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ.SIGMA (%%) 580 +(% style="color: rgb(193,199,208);" %)desc : This parameter gives an indication of the error of the measurement of the average pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%) 581 +(% style="color: rgb(193,199,208);" %)units : microJ 582 + 583 +\\ 584 + 585 +\\ 586 + 722 722 {{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}} 723 723 //always saved (PBD2)// 724 724 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}} 725 725 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}} 726 -desc : Energy per pulse measured in the Tunnel (in fro nt of the gas attenuator and the apertures in the Hall)In addition measurement errors and beam position are included for EACH pulse in the pulse train !! (see below)727 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH USER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**591 +desc : Energy per pulse measured in the Tunnel (in fromt of the gas attenuator and the apertures in the Hall) 592 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]** 728 728 729 -{{info title="GMD pulse resolved data structure"}} 730 -For every pulse in the pulse train the information is saved: 731 - 594 +\\ 732 732 733 -1. **Intensity per pulse** (a.u. (more or less µJ )) 734 -1. Intensity per pulse (auxillary GMD) - not used 735 -1. Position horizontal (mm, for a single pulse the position information may be very noisy - talk to your local contact) 736 -1. Position vertical (mm, for a single pulse the position information may be very noisy - talk to your local contact) 737 -1. **Intensity per pulse sigma** (a.u. (more or less µJ ), (% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%)) 738 -1. Position horizontal sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 739 -1. Position vertical sigma (mm, indicates the error (RMS, sigma) of the measurement according to known uncertainties and signal to noise) 740 -1. Combined warning and error flags 596 +\\ 741 741 742 -The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 743 -file 598 +{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel uncertainty (sigma){{/code}} 599 +//always saved (PBD2)// 600 +DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.SIGMA.TD{{/code}} 601 +DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:4{{/code}} 602 +desc :(% style="color: rgb(0,0,0);" %)This parameter gives an indication of the error of the measurement of the pulse energy. This takes signal to noise, detector resolution, uncertainties in crossection etc into account. (it is NOT the measurement of the statistical fluctuation of the SASE pulses)(%%) 603 +units : a.u. (more or less µJ - related to the value of the pulse energy ) 744 744 745 - 746 -[[image:attach:image2021-2-9_10-51-6.png||height="250"]] 747 747 748 -\\ 749 -{{/info}} 606 +{{code language="none"}}{{/code}} 750 750 751 -\\ 752 - 753 753 All values for the GMD are also available for the** HALL GMD **which is located in the experimental hall down stream the gas attenuator. If the attenuator is on the ratio between Hall and Tunnel signal shows the attenuation. **BUT NOTE** that the filter unit and the Aperture 4 are downstream the GMD. So if filters and aperture are used this influence is NOT measured by the GMD hall ! 754 754 755 755 \\ ... ... @@ -776,15 +776,13 @@ 776 776 777 777 \\ 778 778 779 -/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x 780 -always saved (PBD2) 781 -DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TD 782 -DAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 783 -desc: Besides the well calibrated averaged beam position information there is also the option to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...) 784 -units : mm   785 785 786 -(x=horizontal, y = vertial) 635 +//always saved (PBD2)// 636 +\\\\{{code language="none"}}/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel x DOOCS prop : FLASH.FEL/XGM.BPM/FL2.HALL/X.TDDAQ channel: FLASH.FEL/XGM.BPM/FL2.HALL:2 desc: {{/code}}Besides the well calibrated averaged beam position information there is also the option 637 +{{code language="none"}}to measure the beam position on a single bunch level. HOWEVER this methide needs a perfectly adjusted signal level (talk to your local contact !!) and also then the signal to noise is rather small and one needs some averaging ... BUT with this option one can determine if there was a spatial slope on a burst (say forst bunches were lower than the last ones or so ...)units : mm    {{/code}} 787 787 639 +{{code language="none"}}(x=horizontal, y = vertial){{/code}} 640 + 788 788 again the same parameter set is available for the **HALL GMD** 789 789 790 790 \\ ... ... @@ -870,30 +870,17 @@ 870 870 ===== 871 871 arrival time ===== 872 872 873 -{{code language="none"}}/FL2/Electron Diagnostic/BAM/8FL2XTDS/electron bunch arrival time (low charge){{/code}} 874 -//always saved (PBD2)// 875 -DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/8FL2XTDS/LOW_CHARGE_ARRIVAL_TIME{{/code}} 876 -DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/8FL2XTDS.LOW_CHARGE_ARRIVAL_TIME{{/code}} 877 -desc: Electron bunch arrival time measured with the BAM after the FLASH2 undulator (pulse resolved data) 878 -units: ps (bigger numbers indicate later arrivaltime of the electrons) 879 - 880 880 **FL1**{{code language="none"}}//Electron Diagnostic/BAM/4DBC3/electron bunch arrival time (low charge){{/code}} 881 881 //always saved (PBD2)// 882 882 DOOCS prop : {{code language="none"}}FLASH.SDIAG/BAM/4DBC3/LOW_CHARGE_ARRIVAL_TIME{{/code}} 883 883 DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}} 884 -desc: Electron bunch arrival time measured with the BAM ÂintheacceleratorÂ(pulse resolved data)730 +desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data) 885 885 units: ps (bigger numbers indicate later arrivaltime of the electrons) 886 886 887 -\\ 733 +The BAM measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches. 734 +After a gap of about 70 micros ( 70 colums) with as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start. The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ... 888 888 889 -{{info title="BAM hints"}} 890 -* The BAM 4DBC3 measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). 891 -* The BAM 8FL2XTDS measures only for FLASH2 BUT has the same data structure as the other BAMS ... thus there are also (random) values in in the FLASH1 time slot 892 -** Structure: The first values are for FLASH1 bunches. After a gap of about 70 micros ( 70 colums) with as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start. The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ... .In case of doubt ask your local contact 893 -* [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments >>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]] 894 -* [[LINK to detailed infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] 895 -* a recent [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]] 896 -{{/info}} 736 +Docu for BAM: [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]] 897 897 898 898 899 899 [[Contents>>doc:||anchor="Contents"]] ... ... @@ -1023,7 +1023,7 @@ 1023 1023 There may be more information available from the "Laser DAQ". laese contact your Laser Local Contact. 1024 1024 1025 1025 1026 -{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/attenuat or position{{/code}}//always saved (PBD2)//866 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/laser attenuation{{/code}}//always saved (PBD2)// 1027 1027 DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}} 1028 1028 DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}} 1029 1029 desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate) ... ... @@ -1032,9 +1032,9 @@ 1032 1032 \\ 1033 1033 1034 1034 1035 -{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/polarization position{{/code}}//always saved (PBD2)//1036 -DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR 2.FL24/FPOS{{/code}}1037 -DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR 2.FL24/FPOS{{/code}}875 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/laser polarization{{/code}}//always saved (PBD2)// 876 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}} 877 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}} 1038 1038 desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate) 1039 1039 units : deg. 1040 1040 ... ... @@ -1049,23 +1049,225 @@ 1049 1049 1050 1050 \\ 1051 1051 1052 -{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS{{/code}} 892 +\\ 893 + 894 +{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO{{/code}} 1053 1053 //always saved (PBD)// 1054 -DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}} 1055 -DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}} 1056 -desc: rms jitter of the fs-Oscillator 1057 -units: fs 896 +DOOCS prop : {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}} 897 +DAQ channel: {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}} 898 +desc: rms jitter of the GECCO (% class="twikiNewLink" %)TiSa(%%) Oscillator units: fs 1058 1058 900 +\\ 901 + 902 +{{code language="none"}}/FL1/Experiment/Pump probe laser/streak camera delay time{{/code}} 903 +//always saved (PBD)// 904 +DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}} 905 +DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}} 906 +desc: delaytime between the optical laser and the FEL units: ps 907 + 908 +\\ 909 + 1059 1059 [[Contents>>doc:||anchor="Contents"]] 1060 1060 1061 1061 \\ 1062 1062 1063 - === "/uncategorized/" ===914 +\\ 1064 1064 1065 - If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names916 +\\ 1066 1066 1067 1067 \\ 1068 1068 920 +(% class="wrapped" %) 921 +|=((( 922 +\\ 923 +)))|=((( 924 +\\ 925 +))) 926 +|((( 927 +\\ 928 +)))|((( 929 +\\ 930 +))) 931 +|((( 932 +\\ 933 +)))|((( 934 +\\ 935 +))) 936 +|((( 937 +\\ 938 +)))|((( 939 +\\ 940 +))) 941 +|((( 942 +\\ 943 +)))|((( 944 +\\ 945 +))) 946 +|((( 947 +\\ 948 +)))|((( 949 +\\ 950 +))) 951 +|((( 952 +\\ 953 +)))|((( 954 +\\ 955 +))) 956 +|((( 957 +\\ 958 +)))|((( 959 +\\ 960 +))) 961 +|((( 962 +\\ 963 +)))|((( 964 +\\ 965 +))) 966 +|((( 967 +\\ 968 +)))|((( 969 +\\ 970 +))) 971 +|((( 972 +\\ 973 +)))|((( 974 +\\ 975 +))) 976 +|((( 977 +\\ 978 +)))|((( 979 +\\ 980 +))) 981 +|((( 982 +\\ 983 +)))|((( 984 +\\ 985 +))) 986 +|((( 987 +\\ 988 +)))|((( 989 +\\ 990 +))) 991 +|((( 992 +\\ 993 +)))|((( 994 +\\ 995 +))) 996 +|((( 997 +\\ 998 +)))|((( 999 +\\ 1000 +))) 1001 +|((( 1002 +\\ 1003 +)))|((( 1004 +\\ 1005 +))) 1006 +|((( 1007 +\\ 1008 +)))|((( 1009 +\\ 1010 +))) 1011 +|((( 1012 +\\ 1013 +)))|((( 1014 +\\ 1015 +))) 1016 +|((( 1017 +\\ 1018 +)))|((( 1019 +\\ 1020 +))) 1021 +|((( 1022 +\\ 1023 +)))|((( 1024 +\\ 1025 +))) 1026 +|((( 1027 +\\ 1028 +)))|((( 1029 +\\ 1030 +))) 1031 +|((( 1032 +\\ 1033 +)))|((( 1034 +\\ 1035 +))) 1036 +|((( 1037 +\\ 1038 +)))|((( 1039 +\\ 1040 +))) 1041 +|((( 1042 +\\ 1043 +)))|((( 1044 +\\ 1045 +))) 1046 +|((( 1047 +\\ 1048 +)))|((( 1049 +\\ 1050 +))) 1051 +|((( 1052 +\\ 1053 +)))|((( 1054 +\\ 1055 +))) 1056 +|((( 1057 +\\ 1058 +)))|((( 1059 +\\ 1060 +))) 1061 +|((( 1062 +\\ 1063 +)))|((( 1064 +\\ 1065 +))) 1066 +|((( 1067 +\\ 1068 +)))|((( 1069 +\\ 1070 +))) 1071 +|((( 1072 +\\ 1073 +)))|((( 1074 +\\ 1075 +))) 1076 +|((( 1077 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD 1078 +)))|((( 1079 +/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS 1080 +))) 1081 +|((( 1082 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/LOCK_STATUS.VALUE.RD 1083 +)))|((( 1084 +/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO 1085 +))) 1086 +|((( 1087 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD 1088 +)))|((( 1089 +/FL2/Experiment/Pump probe laser/laser delay readback 1090 +))) 1091 +|((( 1092 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION_SET.WR 1093 +)))|((( 1094 +/FL2/Experiment/Pump probe laser/laser delay set value 1095 +))) 1096 +|((( 1097 +FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS 1098 +)))|((( 1099 +/FL2/Experiment/Pump probe laser/FL24/attenuator position 1100 +))) 1101 +|((( 1102 +FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/POS 1103 +)))|((( 1104 +/FL2/Experiment/Pump probe laser/FL24/polarization position 1105 +))) 1106 + 1107 +\\ 1108 + 1109 +[[Contents>>doc:||anchor="Contents"]] 1110 + 1069 1069 === HDF5 structure revisions === 1070 1070 1071 1071 Starting with Beamblock 4, August 2018, the hierarchy of the HDF group names have been adapted to reflect the new situation at FLASH. FLASH2 is operating for users quite some time now. Therefore, both accelerators appear equally in their respective HDF groups, namely "/FL1" and "/FL2". The root group of proper, by run organised HDF files have an attribute called "version". This version attribute has changed from "0.2.x" to "0.3.x". The changes in detail: ... ... @@ -1185,6 +1185,65 @@ 1185 1185 1186 1186 \\ 1187 1187 1230 +=== Samples how to read HDF5 with Matlab === 1231 + 1232 +The examples apply to HDF files with HDF tree version before vers. 0.3.0. 1233 + 1234 +(% style="color: rgb(0,128,0);" %)%% read in the needed data p=path; path(p,'D:\mess-daten\DAQ-data\hdf5\Gotthard') % add the actual folder to the path hdf5file='FLASH1_EXP-2016-03-16T1420.h5'; % data with Gotthard and VLS 1235 + 1236 +(% style="color: rgb(0,128,0);" %)% h5disp(hdf5file,'/','min') % to get an idea what is in the file % h5info(hdf5file,'/Experiment/Gotthard1/BL.0') % get info about the individual channel 1237 + 1238 +(% style="color: rgb(0,128,0);" %)% read a Number per 10 Hz pulse train: 1239 + 1240 +(% class="code" %) 1241 +((( 1242 +FEL_Wavelength_energy_server=h5read(hdf5file,'/Photon Diagnostic/Wavelength/Calculated by energy/wavelength' ); 1243 +))) 1244 + 1245 +(% style="color: rgb(0,128,0);" %)% read in a 1D array (spectrum) %GMD data GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA'); 1246 + 1247 +(% style="color: rgb(0,128,0);" %)% This reads in all the data . One can also limit the amount of data read to a subset of the data stored in the file. e.g. for image Data (Gotthard) 1248 + 1249 +\\ 1250 + 1251 +(% class="code" %) 1252 +((( 1253 +Start_event= 500 ; % define the first 10 Hz event 1254 + Number_of_events = 20; % how many 10 Hz events to load 1255 +))) 1256 + 1257 +(% style="color: rgb(0,128,0);" %)% read only part of the data: 1258 + 1259 +(% class="code" %) 1260 +((( 1261 +Gotthard_data=h5read(hdf5file,'/Experiment/Gotthard1/BL.0',[2 650 Start_event],[50 85 Number_of_events]); 1262 +))) 1263 + 1264 +(% style="color: rgb(0,128,0);" %)% start stop increment "manual" for 2 D data : [start bunch number in Gotthard data start pixelin spectrum start sample in 10 Hz trains], % [number of bunches in the Gotthard data number of points in the spectrum number of spectra ] 1265 + 1266 +(% class="code" %) 1267 +((( 1268 +VLS_Spectrum=h5read(hdf5file,'/Photon Diagnostic/Wavelength/VLS online spectrometer/PCO.ROI.X',[400 Start_event],[200 Number_of_events] ); 1269 + 1270 +))) 1271 + 1272 +(% style="color: rgb(0,128,0);" %)% start stop increment "manual" for 1D data : [start sample in the spectrum start sample in 10 Hz trains],[number of points in the spectrum number of spectra ] 1273 + 1274 +(% style="color: rgb(0,128,0);" %)%GMD data 1275 + 1276 +(% class="code" %) 1277 +((( 1278 +GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA',[1 Start_event],[40 Number_of_events] ); 1279 +))) 1280 + 1281 +[[Contents>>doc:||anchor="Contents"]] 1282 + 1283 +=== How to read HDF5 with Python via FLASHH5 === 1284 + 1285 +With [[FlashH5>>doc:FLASHUSER.FLASHH5 for easier access of FLASH's HDF5 files]] we provide h5py based examples to access and evaluate FLASH's HDF5 files. 1286 + 1287 +\\ 1288 + 1188 1188 == HDF5 and DOOCS == 1189 1189 1190 1190 Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>attach:FLASH1__DaqChannel2HdfNamePbd.xlsx]] HDF5 names and the corresponding DOOCS names