Changes for page The FLASH HDF5 structure
Last modified by sndueste on 2025/02/06 10:55
From version 1.1
edited by sendels
on 2019/05/15 12:57
on 2019/05/15 12:57
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - Information about the FLASH HDF5 structure1 +The FLASH HDF5 structure - Content
-
... ... @@ -2,22 +2,22 @@ 2 2 3 3 \\ 4 4 5 -* General information about HDF5 6 -* FLASH HDF5 structure 7 -* Most popular FLASH parameters and their names in HDF5 8 -** FLASH1 9 -*** Beamline info (FLASH1) 10 -*** Photon Diagnostics: SASE / Spectrometer (FLASH1) 11 -*** Electron Beam properties (FLASH1) 12 -*** Timing information, rep rate etc.(FLASH1) 13 -*** Pump Probe Laser (FLASH1) 14 -*** User Data (FLASH1) 15 -** FLASH2 16 -** HDF5 structure revisions 17 -* Example code showing how to access HDF5 files 18 -** Samples how to read HDF5 with Matlab 19 -** How to read HDF5 with Python via FLASHH5 20 -* HDF5 and DOOCS 5 +* [[General information about HDF5>>doc:||anchor="General information about HDF5"]] 6 +* [[FLASH HDF5 structure>>doc:||anchor="FLASH HDF5 structure"]] 7 +* [[Most popular FLASH parameters and their names in HDF5>>doc:||anchor="Most popular FLASH parameters and their names in HDF5"]] 8 +** [[FLASH1>>doc:||anchor="FLASH1"]] 9 +*** [[Beamline info (FLASH1)>>doc:||anchor="Beamline info (FLASH1)"]] 10 +*** [[Photon Diagnostics SASE / Spectrometer (FLASH1)>>doc:||anchor="Photon Diagnostics SASE / Spectrometer (FLASH1)"]] 11 +*** [[Electron Beam properties (FLASH1)>>doc:||anchor="Electron Beam properties (FLASH1)"]] 12 +*** [[Timing information, rep rate etc.(FLASH1)>>doc:||anchor="Timing information, rep rate etc.(FLASH1)"]] 13 +*** [[Pump Probe Laser (FLASH1)>>doc:||anchor="Pump Probe Laser (FLASH1)"]] 14 +*** [[User Data (FLASH1)>>doc:||anchor="User Data (FLASH1)"]] 15 +** [[FLASH2>>doc:||anchor="FLASH2"]] 16 +** [[HDF5 structure revisions>>doc:||anchor="HDF5 structure revisions"]] 17 +* [[Example code showing how to access HDF5 files>>doc:||anchor="Example code showing how to access HDF5 files"]] 18 +** [[Samples how to read HDF5 with Matlab>>doc:||anchor="Samples how to read HDF5 with Matlab"]] 19 +** [[How to read HDF5 with Python via FLASHH5>>doc:||anchor="How to read HDF5 with Python via FLASHH5"]] 20 +* [[HDF5 and DOOCS>>doc:||anchor="HDF5 and DOOCS"]] 21 21 22 22 \\ 23 23 ... ... @@ -33,7 +33,7 @@ 33 33 {{code language="none"}}> module load xray{{/code}} 34 34 {{code language="none"}}> hdfview{{/code}} 35 35 36 - \\36 +[[Contents>>doc:||anchor="Contents"]] 37 37 38 38 == FLASH HDF5 structure == 39 39 ... ... @@ -44,12 +44,12 @@ 44 44 * Beamlines 45 45 * Experiment 46 46 * Timing 47 -[[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg||alt="HDF5_structure.jpg" width="700" height="500"]] 47 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure.jpg~|~|alt="HDF5_structure.jpg" width="700" height="500"~]~]>>attach:HDF5_structure.jpg]] 48 48 49 49 A detailled description of (most) channels can be found in the lower part of the hdf5 viewer: 50 -[[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg||alt="HDF5_structure_desc.jpg" width="341" height="413"]] 50 +[[~[~[image:url:http://hasfweb.desy.de/pub/Setup/HDF5main/HDF5_structure_desc.jpg~|~|alt="HDF5_structure_desc.jpg" width="341" height="413"~]~]>>attach:HDF5_structure_desc.jpg]] 51 51 52 - \\52 +[[Contents>>doc:||anchor="Contents"]] 53 53 54 54 \\ 55 55 ... ... @@ -96,7 +96,7 @@ 96 96 //always saved (PBD)// 97 97 DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}} 98 98 DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}} 99 -desc: Position of the BL filterwheel 1 - to correlate with the filter material please look [[here>> url:http://hasfweb.desy.de/bin/view/Setup/FilterHistory||shape="rect"class="twikiLink"]]99 +desc: Position of the BL filterwheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]] 100 100 units: degree 101 101 \\ 102 102 ... ... @@ -104,7 +104,7 @@ 104 104 //always saved (PBD)// 105 105 DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}} 106 106 DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}} 107 -desc: Position of the BL filterwheel 2 - to correlate with the filter material please look [[here>> url:http://hasfweb.desy.de/bin/view/Setup/FilterHistory||shape="rect"class="twikiLink"]]107 +desc: Position of the BL filterwheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]] 108 108 units: degree 109 109 \\ 110 110 ... ... @@ -132,9 +132,9 @@ 132 132 units: degree 133 133 \\ 134 134 135 - \\135 +[[Contents>>doc:||anchor="Contents"]] 136 136 137 -==== Photon Diagnostics :SASE / Spectrometer (FLASH1) ====137 +==== Photon Diagnostics SASE / Spectrometer (FLASH1) ==== 138 138 139 139 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}} 140 140 //always saved (PBD)// ... ... @@ -148,7 +148,7 @@ 148 148 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}} 149 149 DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}} 150 150 desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL 151 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>> url:http://hasfweb.desy.de/bin/view/Setup/CalibrateGMDSignals||shape="rect"class="twikiLink"]]151 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 152 152 153 153 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}} 154 154 //always saved (PBD)// ... ... @@ -155,7 +155,7 @@ 155 155 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}} 156 156 DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}} 157 157 desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise 158 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>> url:http://hasfweb.desy.de/bin/view/Setup/CalibrateGMDSignals||shape="rect"class="twikiLink"]]158 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 159 159 160 160 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}} 161 161 //always saved (PBD)// ... ... @@ -169,7 +169,7 @@ 169 169 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}} 170 170 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}} 171 171 desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL 172 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>> url:http://hasfweb.desy.de/bin/view/Setup/CalibrateGMDSignals||shape="rect"class="twikiLink"]]172 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 173 173 174 174 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}} 175 175 //always saved (PBD)// ... ... @@ -176,13 +176,13 @@ 176 176 DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}} 177 177 DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}} 178 178 desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise 179 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>> url:http://hasfweb.desy.de/bin/view/Setup/CalibrateGMDSignals||shape="rect"class="twikiLink"]]179 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]] 180 180 181 181 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}} 182 182 //always saved (PBD)// 183 183 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}} 184 184 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}} 185 -desc :Beam position of the photon Beam determined by the [[GMD>> url:http://hasfweb.desy.de/bin/view/Setup/GMD||shape="rect" class="twikiLink"]] (BDA, x=horizontal)185 +desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, x=horizontal) 186 186 units : mm 187 187 188 188 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}} ... ... @@ -189,7 +189,7 @@ 189 189 //always saved (PBD)// 190 190 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}} 191 191 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}} 192 -desc :Beam position of the photon Beam determined by the [[GMD>> url:http://hasfweb.desy.de/bin/view/Setup/GMD||shape="rect" class="twikiLink"]] (BDA, y=vertical)192 +desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, y=vertical) 193 193 units : mm 194 194 195 195 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}} ... ... @@ -196,7 +196,7 @@ 196 196 //always saved (PBD)// 197 197 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}} 198 198 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}} 199 -desc :Beam position of the photon Beam determined by the [[GMD>> url:http://hasfweb.desy.de/bin/view/Setup/GMD||shape="rect" class="twikiLink"]] (TUNNEL, x=horizontal)199 +desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, x=horizontal) 200 200 units : mm 201 201 202 202 {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}} ... ... @@ -203,7 +203,7 @@ 203 203 //always saved (PBD)// 204 204 DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}} 205 205 DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}} 206 -desc :Beam position of the photon Beam determined by the [[GMD>> url:http://hasfweb.desy.de/bin/view/Setup/GMD||shape="rect" class="twikiLink"]] (TUNNEL, y=vertical)206 +desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, y=vertical) 207 207 units : mm 208 208 209 209 {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}} ... ... @@ -269,7 +269,7 @@ 269 269 desc : increment value (in nm) for each pixel for the wavelength axis of the XUV Spectrum measured with the "PG spectrometer" 270 270 units : nm 271 271 272 - \\272 +[[Contents>>doc:||anchor="Contents"]] 273 273 274 274 ==== Electron Beam properties (FLASH1) ==== 275 275 ... ... @@ -334,7 +334,7 @@ 334 334 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_INTRA_MEAN/VAL{{/code}} 335 335 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_MEAN{{/code}} 336 336 desc: electron bunch energy (average over the bunch train) 337 -units: (% class="twikiNewLink" %) [[MeV>>url:http://hasfweb.desy.de/bin/edit/Setup/MeV?topicparent=Setup.HDF5main;nowysiwyg=0||rel="nofollow" shape="rect"]](%%)337 +units: (% class="twikiNewLink" %)MeV(%%) 338 338 \\ 339 339 340 340 {{code language="none"}}/FL1/Electron Diagnostic/Electron energy/pulse resolved energy{{/code}} ... ... @@ -342,7 +342,7 @@ 342 342 DOOCS prop : {{code language="none"}}TTF2.DAQ/ENERGY.DOGLEG/E_SPECT/VAL.TD{{/code}} 343 343 DAQ channel: {{code language="none"}}PBD.ENERGY.DOGLEG/E_SPECT{{/code}} 344 344 desc: electron bunch energy bunch resolved 345 -units: (% class="twikiNewLink" %) [[MeV>>url:http://hasfweb.desy.de/bin/edit/Setup/MeV?topicparent=Setup.HDF5main;nowysiwyg=0||rel="nofollow" shape="rect"]](%%)345 +units: (% class="twikiNewLink" %)MeV(%%) 346 346 \\ 347 347 348 348 \\ ... ... @@ -355,7 +355,7 @@ 355 355 units: nm 356 356 \\ 357 357 358 - \\358 +[[Contents>>doc:||anchor="Contents"]] 359 359 360 360 \\ 361 361 ... ... @@ -436,7 +436,7 @@ 436 436 third column: Train ID of FLASH 437 437 \\ 438 438 439 - \\439 +[[Contents>>doc:||anchor="Contents"]] 440 440 441 441 \\ 442 442 ... ... @@ -466,7 +466,7 @@ 466 466 //always saved (PBD)// 467 467 DOOCS prop : {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}} 468 468 DAQ channel: {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}} 469 -desc: rms jitter of the GECCO (% class="twikiNewLink" %) [[TiSa>>url:http://hasfweb.desy.de/bin/edit/Setup/TiSa?topicparent=Setup.HDF5main;nowysiwyg=0||rel="nofollow" shape="rect"]](%%) Oscillator units: fs469 +desc: rms jitter of the GECCO (% class="twikiNewLink" %)TiSa(%%) Oscillator units: fs 470 470 471 471 \\ 472 472 ... ... @@ -478,7 +478,7 @@ 478 478 479 479 \\ 480 480 481 - \\481 +[[Contents>>doc:||anchor="Contents"]] 482 482 483 483 \\ 484 484 ... ... @@ -488,7 +488,7 @@ 488 488 489 489 ===== GHz ADCs ===== 490 490 491 -ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>> url:http://hasfweb.desy.de/bin/view/Setup/MtcaAdc||shape="rect" class="twikiLink"]]491 +ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]] 492 492 //saved on DEMAND in the user DAQ// 493 493 \\The HDF5 names for the ADC traces are depending on the beamline : 494 494 \\PG Beamline: ... ... @@ -528,16 +528,17 @@ 528 528 529 529 \\ 530 530 531 - \\531 +[[Contents>>doc:||anchor="Contents"]] 532 532 533 533 === FLASH2 === 534 534 535 535 \\ 536 536 537 +(% class="wrapped" %) 537 537 |=((( 538 - [[DAQ name>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=0;table=1;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]539 +DAQ name 539 539 )))|=((( 540 - [[HDF5 name>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=1;table=1;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]541 +HDF5 name 541 541 ))) 542 542 |((( 543 543 FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP ... ... @@ -722,7 +722,7 @@ 722 722 723 723 \\ 724 724 725 - \\726 +[[Contents>>doc:||anchor="Contents"]] 726 726 727 727 === HDF5 structure revisions === 728 728 ... ... @@ -736,10 +736,11 @@ 736 736 737 737 \\ 738 738 740 +(% class="wrapped" %) 739 739 |=((( 740 - [[earlier HDF path (vers. 0.2)>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=0;table=2;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]742 +earlier HDF path (vers. 0.2) 741 741 )))|=((( 742 - [[is now (vers. 0.3)>>url:http://hasfweb.desy.de/bin/view/Setup/HDF5main?sortcol=1;table=2;up=0#sorted_table||title="Sort by this column" rel="nofollow" shape="rect"]]744 +is now (vers. 0.3) 743 743 ))) 744 744 |((( 745 745 /Photon Diagnostic/GMD/Beam position/position BDA x ... ... @@ -834,7 +834,7 @@ 834 834 835 835 \\ 836 836 837 - \\839 +[[Contents>>doc:||anchor="Contents"]] 838 838 839 839 \\ 840 840 ... ... @@ -893,14 +893,16 @@ 893 893 GMD_Spectrum=h5read(hdf5file,'/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA',[1 Start_event],[40 Number_of_events] ); 894 894 ))) 895 895 896 - \\898 +[[Contents>>doc:||anchor="Contents"]] 897 897 898 898 === How to read HDF5 with Python via FLASHH5 === 899 899 900 -With [[FlashH5>> url:http://hasfweb.desy.de/bin/view/Setup/FlashH5||shape="rect"class="twikiLink"]] we provide h5py based examples to access and evaluate FLASH's HDF5 files.902 +With [[FlashH5>>doc:FLASHUSER.FLASHH5 for easier access of FLASH's HDF5 files]] we provide h5py based examples to access and evaluate FLASH's HDF5 files. 901 901 902 902 \\ 903 903 904 904 == HDF5 and DOOCS == 905 905 906 -Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>url:http://hasfweb.desy.de/pub/Setup/HDF5main/FLASH1__DaqChannel2HdfNamePbd.xlsx||shape="rect"]] HDF5 names and the corresponding DOOCS names 908 +Here is an outdated [[list with the available properties that are always saved (PBD) for FLASH1 as>>attach:FLASH1__DaqChannel2HdfNamePbd.xlsx]] HDF5 names and the corresponding DOOCS names 909 + 910 +[[Contents>>doc:||anchor="Contents"]]