Skip to Content

Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/09/10 11:43
From version 89.13
edited by sndueste
on 2025/04/24 13:24
Change comment: There is no comment for this version
To version 97.2
edited by sndueste
on 2025/05/19 17:20
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -103,11 +103,10 @@
103 103  {{/info}}
104 104  {{/layout-cell}}
105 105  {{/layout-section}}
106 +{{/layout}}
106 106  
107 -{{layout-section ac:type="single"}}
108 -{{layout-cell}}
109 -
110 110  
109 +
111 111  == Complete list of recordable parameters ==
112 112  
113 113  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
... ... @@ -116,13 +116,17 @@
116 116  
117 117  {{id name="DOOCSparameters"/}}
118 118  
119 -Note, the HDF group and data set names apply to our HDF tree version since vers. 0.3.0.
120 120  
121 -
122 122  === FLASH1 ===
123 123  
124 -==== Beamline info (FLASH1) ====
125 125  
122 +In the Shutdown 2024 / 2025  the complete photon diagnostic and experiment control was renewed and thus the Doocs names and also some HDF5 names had to be changed. The new naming will be documented here as soon as the systems are online again.
123 +
124 +The previously used naming scheme (2024 and before) can be found here:
125 +
126 +{{expand expanded="false" title="FLASH1 Naming scheme used until 2024"}}
127 +==== (% id="cke_bm_8853497S" style="display:none" %) (%%)Beamline info (FLASH1) ====
128 +
126 126  {{code language="none"}}/FL1/Beamlines/Attenuator/pressure{{/code}}
127 127  //always saved (PBD)//
128 128  DOOCS prop : {{code language="none"}}FLASH.FEL/GAS_DOSING/FL1.ATTENUATOR/PRESSURE{{/code}}
... ... @@ -243,8 +243,8 @@
243 243  
244 244  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
245 245  //always saved (PBD)//
246 -(% style="color:#000000" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
247 -(% style="color:#000000" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
249 +(% style="color:#000000" %)DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}} (%%)
250 +(% style="color:#000000" %)DAQ channel: {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL1.TUNNEL/PHOTONFLUX.UJ{{/code}}
248 248  
249 249  desc : calibrated average SASE Energy/pulse measured in the TUNNEL upstream the gas attenuator
250 250  units : microJ
... ... @@ -253,8 +253,8 @@
253 253  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel{{/code}}
254 254  //always saved (PBD)//
255 255  
256 -(% style="color:#000000" %)DOOCS prop : 
257 -{{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
259 +(% style="color:#000000" %)DOOCS prop : (%%)
260 +(% style="color:#000000" %){{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL1.TUNNEL/INTENSITY.TD{{/code}}
258 258  
259 259  desc : Energy per pulse measured in the Tunnel.  In addition measurement errors and beam position are included for EACH pulse in the pulse train  !! (see below)
260 260  units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FS-FLASH USER tmp.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
... ... @@ -274,8 +274,7 @@
274 274  The pulse energy and the error are plotted for the first bunch of the pulse trains saved in this 
275 275  file
276 276  
277 -
278 -[[image:attach:image2021-2-9_10-51-6.png||height="250"]]
280 + [[image:image2021-2-9_10-51-6.png]]
279 279  
280 280  
281 281  {{/info}}
... ... @@ -467,8 +467,8 @@
467 467  
468 468  //always saved (PBD)//
469 469  (% style="color:#172b4d" %)**FL1.SFELC**(%%)
470 -(% style="color:#000000" %)channel: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)FL1.SFELC(% style="color:#000000" %)/ARRIVAL_TIME.ABSOLUTE.SA1.COMP
471 -{{code language="none"}} DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIME.ABSOLUTE.SA1.COMPDAQ {{/code}}(% style="letter-spacing:0.0px" %)desc: Electron bunch arrival time measured  with the BAM  before the undulator (pulse resolved data). This one was newly installed in 2020.. The property contains only the arrival time of the bunches sent to FL1 (e.g. if there are 30 bunches in FL1 the first 30 values are the arrival time the remaining numbers still may have arbitrary numbers looking like a signal which they are not). These are the same values as the "raw" data below - just "cleaned". The values show a very good correlation to the arrival time  of the XUV pulses in the experiment (see help).
472 +(% style="color:#000000" %)channel: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)FL1.SFELC(% style="color:#000000" %)/ARRIVAL_TIME.ABSOLUTE.SA1.COMP(%%)
473 +(% style="color:#000000" %){{code language="none"}} DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIME.ABSOLUTE.SA1.COMPDAQ {{/code}}(% style="letter-spacing:0.0px" %)desc: Electron bunch arrival time measured  with the BAM  before the undulator (pulse resolved data). This one was newly installed in 2020.. The property contains only the arrival time of the bunches sent to FL1 (e.g. if there are 30 bunches in FL1 the first 30 values are the arrival time the remaining numbers still may have arbitrary numbers looking like a signal which they are not). These are the same values as the "raw" data below - just "cleaned". The values show a very good correlation to the arrival time  of the XUV pulses in the experiment (see help).
472 472  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
473 473  
474 474  
... ... @@ -546,20 +546,23 @@
546 546  [[Contents>>doc:||anchor="Contents"]]
547 547  
548 548  
551 +==== ====
552 +
553 +
549 549  ==== Timing information, rep rate etc.  (FLASH1) ====
550 550  
551 551  ===== bunch repetition rate =====
552 552  
553 -{{code language="none"}}/FL1/Timing/repetition rate{{/code}}
558 +{{code language="none"}}/Timing/repetition rate{{/code}}
554 554  //always saved (PBD)//
555 555  DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.1{{/code}}
556 -DAQ channel: {{code language="none"}}TTF2.UTIL/LASER.CONTROL/GUN/PULSE_FREQ{{/code}}
561 +DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.1{{/code}}
557 557  desc: repetition rate of the bunches / pulses within the burst (FLASH1)
558 558  units: kHz
559 559  
560 560  ===== set number of pulses =====
561 561  
562 -(% style="color:#ff6600" %)(HDF5 name not yet implemented - see zraw)(% style="color:#ff0000" %){{code language="none"}}/FL1/Timing/set number of bunches {{/code}}(%%)
567 +(% style="color:#ff6600" %)(HDF5 name not yet implemented - see zraw)(% style="color:#ff0000" %){{code language="none"}}/Timing/set number of bunches {{/code}}(%%)
563 563  //always saved (PBD)//
564 564  DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1 [4th number]{{/code}}
565 565  DAQ channel: {{code language="none"}}FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1 [4th number]{{/code}}
... ... @@ -604,17 +604,22 @@
604 604  second column: microseconds
605 605  third column: Train ID of FLASH
606 606  
607 -currently it is saved as Unix time in
612 +currently it is saved as Unix time in : /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time
608 608  
609 -|(((
610 -/zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time
614 +{{expand expanded="false" title="Timestamp help for python"}}
615 + import time
611 611  
612 -
613 -)))
617 +# epoch time is found in /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time #!!! a leading 1 has to be added !!!
618 +# The time and date of the start of the data taking in the HDF file is encoded in the filename - to roughly check the time
619 +epoch_time = 1709051499.17 # Replace with your epoch time
614 614  
615 -[[Contents>>doc:||anchor="Contents"]]
621 +formatted_time = time.strftime('%Y-%m-%d %H:%M:%S', time.gmtime(epoch_time))
622 +print(formatted_time)
623 +{{/expand}}
616 616  
617 617  
626 +
627 +
618 618  ==== Pump Probe Laser (FLASH1) ====
619 619  
620 620  **PIGLET (PG laser)**
... ... @@ -730,10 +730,9 @@
730 730  * {{code language="none"}}number of samples{{/code}}: total number of samples recorded for each 10 Hz trigger
731 731  
732 732  [[Contents>>doc:||anchor="Contents"]]
743 +{{/expand}}
733 733  
734 734  
735 -
736 -
737 737  === FLASH2 ===
738 738  
739 739  There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
... ... @@ -741,7 +741,6 @@
741 741  ==== Beamline info (FLASH2) ====
742 742  
743 743  {{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}
744 -(% style="color:#000000" %)//always saved (PBD2)// (%%)
745 745  (% style="color:#000000" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
746 746  (% style="color:#000000" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
747 747  (% style="color:#000000" %)desc: set pressure in the gas attenuator (%%)
... ... @@ -748,7 +748,6 @@
748 748  (% style="color:#000000" %)units: mbar
749 749  
750 750  {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
751 -//always saved (PBD2)//
752 752  DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER/CH00.TD{{/code}}
753 753  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER{{/code}}
754 754  desc: BL Beamline Fast shutter state: 1 is open, 0 is closed ( for technical reasons there are 100 vales of this state saved ...)
... ... @@ -756,7 +756,6 @@
756 756  
757 757  
758 758  {{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 1{{/code}}
759 -//always saved (PBD2)//
760 760  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
761 761  DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
762 762  desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FS-FLASH USER tmp.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
... ... @@ -763,7 +763,6 @@
763 763  units: degree
764 764  
765 765  /FL2/Beamlines/Filter wheel/position wheel 2
766 -always saved (PBD2)
767 767  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}}
768 768  DAQ channel: {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS{{/code}}
769 769  desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FS-FLASH USER tmp.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
... ... @@ -779,7 +779,6 @@
779 779  ==== Photon Diagnostics SASE ([[XGMD>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/gmd_intensity_and_position/index_eng.html||shape="rect"]] - FLASH2) ====
780 780  
781 781  {{code language="none"}}/FL2/Photon Diagnostic/GMD/Average energy/energy tunnel{{/code}}
782 -//always saved (PBD2)//
783 783  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
784 784  DAQ channel:{{code language="none"}} FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ{{/code}}
785 785  desc : calibrated average ( ~~ 20 sec averaging time ) SASE Energy/pulse measured in the TUNNEL before the attenuator (ion current)
... ... @@ -1111,10 +1111,10 @@
1111 1111  desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
1112 1112  units:
1113 1113  
1114 -===== Train time =====
1118 +===== (% style="color:#e67e22" %)Train time(%%) =====
1115 1115  
1116 -//always saved (PBD2)//
1117 -{{code language="none"}}/Timing/train time{{/code}}
1120 +(% style="color:#e67e22" %)//always saved (PBD2)//(%%)
1121 +(% style="color:#e67e22" %){{code language="none"}}/Timing/train time{{/code}}
1118 1118  desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
1119 1119  units: d h min s cs
1120 1120  
... ... @@ -1122,11 +1122,28 @@
1122 1122  /Timing/time stamp
1123 1123  {{/code}}
1124 1124  
1125 -//always saved (PBD2)//
1126 -desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
1129 +(% style="color:#e67e22" %)//always saved (PBD2)//(%%)
1130 +(% style="color:#e67e22" %)desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
1127 1127  second column: microseconds
1128 1128  third column: Train ID of FLASH
1129 1129  
1134 +
1135 +(% id="cke_bm_2455529S" style="display:none" %) (%%)currently it is saved as Unix time in : /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time
1136 +
1137 +{{expand expanded="false" title="Timestamp help for python"}}
1138 + import time
1139 +
1140 +# epoch time is found in /zraw/FLASH.DIAG/TIMINGINFO/TIME1.BUNCH_FIRST_INDEX.1/dGroup/time #!!! a leading 1 has to be added !!!
1141 +# The time and date of the start of the data taking in the HDF file is encoded in the filename - to roughly check the time
1142 +epoch_time = 1709051499.17 # Replace with your epoch time
1143 +
1144 +formatted_time = time.strftime('%Y-%m-%d %H:%M:%S', time.gmtime(epoch_time))
1145 +print(formatted_time)
1146 +{{/expand}}
1147 +
1148 +
1149 +
1150 +
1130 1130  [[Contents>>doc:||anchor="Contents"]]
1131 1131  
1132 1132  
... ... @@ -1670,8 +1670,3 @@
1670 1670  )))
1671 1671  
1672 1672  [[Contents>>doc:||anchor="Contents"]]
1673 -
1674 -
1675 -{{/layout-cell}}
1676 -{{/layout-section}}
1677 -{{/layout}}