Skip to Content

Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/09/10 11:43
From version 97.2
edited by sndueste
on 2025/05/19 17:20
Change comment: There is no comment for this version
To version 89.12
edited by sndueste
on 2025/04/24 13:22
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -103,10 +103,11 @@
103 103  {{/info}}
104 104  {{/layout-cell}}
105 105  {{/layout-section}}
106 -{{/layout}}
107 107  
107 +{{layout-section ac:type="single"}}
108 +{{layout-cell}}
109 +
108 108  
109 -
110 110  == Complete list of recordable parameters ==
111 111  
112 112  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
... ... @@ -115,17 +115,13 @@
115 115  
116 116  {{id name="DOOCSparameters"/}}
117 117  
119 +Note, the HDF group and data set names apply to our HDF tree version since vers. 0.3.0.
118 118  
121 +
119 119  === FLASH1 ===
120 120  
124 +==== Beamline info (FLASH1) ====
121 121  
122 -In the Shutdown 2024 / 2025  the complete photon diagnostic and experiment control was renewed and thus the Doocs names and also some HDF5 names had to be changed. The new naming will be documented here as soon as the systems are online again.
123 -
124 -The previously used naming scheme (2024 and before) can be found here:
125 -
126 -{{expand expanded="false" title="FLASH1 Naming scheme used until 2024"}}
127 -==== (% id="cke_bm_8853497S" style="display:none" %) (%%)Beamline info (FLASH1) ====
128 -
129 129  {{code language="none"}}/FL1/Beamlines/Attenuator/pressure{{/code}}
130 130  //always saved (PBD)//
131 131  DOOCS prop : {{code language="none"}}FLASH.FEL/GAS_DOSING/FL1.ATTENUATOR/PRESSURE{{/code}}
... ... @@ -246,8 +246,8 @@
246 246  
247 247  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
248 248  //always saved (PBD)//
249 -(% style="color:#000000" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
250 -(% style="color:#000000" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
246 +(% style="color:#000000" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
247 +(% style="color:#000000" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
251 251  
252 252  desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator
253 253  units : microJ
... ... @@ -256,8 +256,8 @@
256 256  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
257 257  //always saved (PBD)//
258 258  
259 -(% style="color:#000000" %)DOOCS prop : (%%)
260 -(% style="color:#000000" %){{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
256 +(% style="color:#000000" %)DOOCS prop : 
257 +{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
261 261  
262 262  desc : Energy per pulse measured in the Tunnel.  In addition measurement errors and beam position are included for EACH pulse in the pulse train  !! (see below)
263 263  units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FS-FLASH USER tmp.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
... ... @@ -277,7 +277,8 @@
277 277  The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 
278 278  file
279 279  
280 - [[image:image2021-2-9_10-51-6.png]]
277 +
278 +[[image:attach:image2021-2-9_10-51-6.png||height="250"]]
281 281  
282 282  
283 283  {{/info}}
... ... @@ -469,8 +469,8 @@
469 469  
470 470  //always saved (PBD)//
471 471  (% style="color:#172b4d" %)**FL1.SFELC**(%%)
472 -(% style="color:#000000" %)channel: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)FL1.SFELC(% style="color:#000000" %)/ARRIVAL_TIME.ABSOLUTE.SA1.COMP(%%)
473 -(% style="color:#000000" %){{code language="none"}} DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIME.ABSOLUTE.SA1.COMPDAQ {{/code}}(% style="letter-spacing:0.0px" %)desc: Electron bunch arrival time measured  with the BAM  before the undulator (pulse resolved data). This one was newly installed in 2020.. The property contains only the arrival time of the bunches sent to FL1 (e.g. if there are 30 bunches in FL1 the first 30 values are the arrival time the remaining numbers still may have arbitrary numbers looking like a signal which they are not). These are the same values as the "raw" data below - just "cleaned". The values show a very good correlation to the arrival time  of the XUV pulses in the experiment (see help).
470 +(% style="color:#000000" %)channel: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)FL1.SFELC(% style="color:#000000" %)/ARRIVAL_TIME.ABSOLUTE.SA1.COMP
471 +{{code language="none"}} DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIME.ABSOLUTE.SA1.COMPDAQ {{/code}}(% style="letter-spacing:0.0px" %)desc: Electron bunch arrival time measured  with the BAM  before the undulator (pulse resolved data). This one was newly installed in 2020.. The property contains only the arrival time of the bunches sent to FL1 (e.g. if there are 30 bunches in FL1 the first 30 values are the arrival time the remaining numbers still may have arbitrary numbers looking like a signal which they are not). These are the same values as the "raw" data below - just "cleaned". The values show a very good correlation to the arrival time  of the XUV pulses in the experiment (see help).
474 474  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
475 475  
476 476  
... ... @@ -548,23 +548,20 @@
548 548  [[Contents>>doc:||anchor="Contents"]]
549 549  
550 550  
551 -==== ====
552 -
553 -
554 554  ==== Timing information, rep rate etc.  (FLASH1) ====
555 555  
556 556  ===== bunch repetition rate =====
557 557  
558 -{{code language="none"}}/Timing/repetition rate{{/code}}
553 +{{code language="none"}}/FL1/Timing/repetition rate{{/code}}
559 559  //always saved (PBD)//
560 560  DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.1{{/code}}
561 -DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.1{{/code}}
556 +DAQ channel: {{code language="none"}}TTF2.UTIL/LASER.CONTROL/GUN/PULSE_FREQ{{/code}}
562 562  desc: repetition rate of the bunches / pulses within the burst (FLASH1)
563 563  units: kHz
564 564  
565 565  ===== set number of pulses =====
566 566  
567 -(% style="color:#ff6600" %)(HDF5 name not yet implemented - see zraw)(% style="color:#ff0000" %){{code language="none"}}/Timing/set number of bunches {{/code}}(%%)
562 +(% style="color:#ff6600" %)(HDF5 name not yet implemented - see zraw)(% style="color:#ff0000" %){{code language="none"}}/FL1/Timing/set number of bunches {{/code}}(%%)
568 568  //always saved (PBD)//
569 569  DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1 [4th number]{{/code}}
570 570  DAQ channel: {{code language="none"}}FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1 [4th number]{{/code}}
... ... @@ -609,22 +609,13 @@
609 609  second column: microseconds
610 610  third column: Train ID of FLASH
611 611  
612 -currently it is saved as Unix time in : /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time
607 +currently it is saved as Unix time in
613 613  
614 -{{expand expanded="false" title="Timestamp help for python"}}
615 - import time
609 +|/zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time
616 616  
617 -# epoch time is found in /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time #!!! a leading 1 has to be added !!!
618 -# The time and date of the start of the data taking in the HDF file is encoded in the filename - to roughly check the time
619 -epoch_time = 1709051499.17 # Replace with your epoch time
611 +[[Contents>>doc:||anchor="Contents"]]
620 620  
621 -formatted_time = time.strftime('%Y-%m-%d %H:%M:%S', time.gmtime(epoch_time))
622 -print(formatted_time)
623 -{{/expand}}
624 624  
625 -
626 -
627 -
628 628  ==== Pump Probe Laser (FLASH1) ====
629 629  
630 630  **PIGLET (PG laser)**
... ... @@ -740,9 +740,10 @@
740 740  * {{code language="none"}}number of samples{{/code}}: total number of samples recorded for each 10 Hz trigger
741 741  
742 742  [[Contents>>doc:||anchor="Contents"]]
743 -{{/expand}}
744 744  
745 745  
731 +
732 +
746 746  === FLASH2 ===
747 747  
748 748  There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
... ... @@ -750,6 +750,7 @@
750 750  ==== Beamline info (FLASH2) ====
751 751  
752 752  {{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}
740 +(% style="color:#000000" %)//always saved (PBD2)// (%%)
753 753  (% style="color:#000000" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
754 754  (% style="color:#000000" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
755 755  (% style="color:#000000" %)desc: set pressure in the gas attenuator (%%)
... ... @@ -756,6 +756,7 @@
756 756  (% style="color:#000000" %)units: mbar
757 757  
758 758  {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
747 +//always saved (PBD2)//
759 759  DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER/CH00.TD{{/code}}
760 760  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER{{/code}}
761 761  desc: BL Beamline Fast shutter state: 1 is open, 0 is closed ( for technical reasons there are 100 vales of this state saved ...)
... ... @@ -763,6 +763,7 @@
763 763  
764 764  
765 765  {{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 1{{/code}}
755 +//always saved (PBD2)//
766 766  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
767 767  DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
768 768  desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FS-FLASH USER tmp.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
... ... @@ -769,6 +769,7 @@
769 769  units: degree
770 770  
771 771  /FL2/Beamlines/Filter wheel/position wheel 2
762 +always saved (PBD2)
772 772  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}}
773 773  DAQ channel: {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}}
774 774  desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FS-FLASH USER tmp.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
... ... @@ -784,6 +784,7 @@
784 784  ==== Photon Diagnostics SASE ([[XGMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]] - FLASH2) ====
785 785  
786 786  {{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
778 +//always saved (PBD2)//
787 787  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
788 788  DAQ channel:{{code language="none"}} FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
789 789  desc : calibrated average ( ~~ 20 sec averaging time ) SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current)
... ... @@ -1115,10 +1115,10 @@
1115 1115  desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
1116 1116  units:
1117 1117  
1118 -===== (% style="color:#e67e22" %)Train time(%%) =====
1110 +===== Train time =====
1119 1119  
1120 -(% style="color:#e67e22" %)//always saved (PBD2)//(%%)
1121 -(% style="color:#e67e22" %){{code language="none"}}/Timing/train time{{/code}}
1112 +//always saved (PBD2)//
1113 +{{code language="none"}}/Timing/train time{{/code}}
1122 1122  desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
1123 1123  units: d h min s cs
1124 1124  
... ... @@ -1126,28 +1126,11 @@
1126 1126  /Timing/time stamp
1127 1127  {{/code}}
1128 1128  
1129 -(% style="color:#e67e22" %)//always saved (PBD2)//(%%)
1130 -(% style="color:#e67e22" %)desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
1121 +//always saved (PBD2)//
1122 +desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
1131 1131  second column: microseconds
1132 1132  third column: Train ID of FLASH
1133 1133  
1134 -
1135 -(% id="cke_bm_2455529S" style="display:none" %) (%%)currently it is saved as Unix time in : /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time
1136 -
1137 -{{expand expanded="false" title="Timestamp help for python"}}
1138 - import time
1139 -
1140 -# epoch time is found in /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time #!!! a leading 1 has to be added !!!
1141 -# The time and date of the start of the data taking in the HDF file is encoded in the filename - to roughly check the time
1142 -epoch_time = 1709051499.17 # Replace with your epoch time
1143 -
1144 -formatted_time = time.strftime('%Y-%m-%d %H:%M:%S', time.gmtime(epoch_time))
1145 -print(formatted_time)
1146 -{{/expand}}
1147 -
1148 -
1149 -
1150 -
1151 1151  [[Contents>>doc:||anchor="Contents"]]
1152 1152  
1153 1153  
... ... @@ -1691,3 +1691,8 @@
1691 1691  )))
1692 1692  
1693 1693  [[Contents>>doc:||anchor="Contents"]]
1669 +
1670 +
1671 +{{/layout-cell}}
1672 +{{/layout-section}}
1673 +{{/layout}}