Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 86.1
edited by sndueste
on 2024/09/23 14:26
Change comment: There is no comment for this version
To version 79.1
edited by sndueste
on 2024/04/25 16:51
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -10,9 +10,9 @@
10 10  
11 11  == General information about HDF5 ==
12 12  
13 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
13 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
14 14  
15 -To download the HDF5 Viewer click [[here>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
15 +To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
16 16  
17 17  For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module :
18 18  {{code language="none"}}> module load xray{{/code}}
... ... @@ -68,6 +68,7 @@
68 68  {{layout-cell}}
69 69  * ADC data as example for **fast** **data** (10 Hz):            
70 70  
71 +
71 71  [[image:attach:image2020-11-16_15-26-28.png||height="250"]]
72 72  {{/layout-cell}}
73 73  
... ... @@ -110,7 +110,7 @@
110 110  
111 111  == Complete list of recordable parameters ==
112 112  
113 -The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
114 +The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
114 114  
115 115  
116 116  == Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
... ... @@ -456,9 +456,9 @@
456 456  
457 457  (% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
458 458  //always saved (PBD)//
459 -DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError.1(%%)
460 -DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.1(%%)
461 -desc:(% style="letter-spacing:0.0px" %) status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
460 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError(%%)
461 +DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR(%%)
462 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
462 462  
463 463  
464 464  (% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
... ... @@ -630,17 +630,34 @@
630 630  
631 631  **{{code language="none"}}/FL1/Experiment/Pump probe laser{{/code}}**
632 632  
633 -{{info width="30%"}}
634 -list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
634 +FLASH.LASER/FLACPUPGLASER1.PULSEENERGY/DIAG1out/PULSEENERGY.MEAN 
635 +FLASH.LASER/FLACPUPGLASER1.PULSEENERGY/PG1_incoupl/PULSEENERGY.MEAN 
636 +FLASH.LASER/FLACPUPGLASER1.PULSEENERGY/PG2_incoupl/PULSEENERGY.MEAN 
637 +FLASH.SYNC/LASER.LOCK.EXP/FLASH1.MOD1.PG.OSC/FMC0.MD22.1.ENCODER_POSITION.RD 
638 +FLASH.SYNC/LASER.LOCK.EXP/FLASH1.MOD1.PG.OSC/FMC0.MD22.1.ENCODER_POSITION_RAW.RD 
639 +FLASH.SYNC/LASER.LOCK.EXP/FLASH1.MOD1.PG.OSC/FMC0.MD22.1.POSITION.RD
635 635  
636 -Download the PDF:
641 +**BL - Hidra laser **
637 637  
638 -{{view-file att--filename="FSLADAQ-DAQParameterlistPiGLET.pdf"}}{{/view-file}}
643 +Property,Units,Description
644 +FLASH.LASER/MODBL.CAM/BL1.13.AC/DAQ_CHANNEL,'AU','FL1HIDRAPP1 Autocorrelation (IR) ROI readout'
645 +FLASH.LASER/MODBL.CAM/BL1.14.VF/DAQ_CHANNEL,'AU','FL1HIDRAPP1 Virtual Focus Camera (IR) ROI readout'
646 +FLASH.LASER/MODBL.SENSORBOARD/PDTRIG_CAMP/DAQ_CHANNEL,'au','FL1PPL Energy channels'
647 +FLASH.LASER/MODBL.SPECT/CAMP_IR/DAQ_CHANNEL,'au','FL1PPL BL Table Spectrum'
648 +FLASH.LASER/HIDRAPP1.SPECTRUM_ANALYSIS/CAMP_IR/DAQ_CHANNEL,'au','FL1PPL Spectrum Analysis'
649 +FLASH.SYNC/LASER.LOCK.EXP/F1.PPL.OSC/FMC0.MD22.1.POSITION.RD,'ps','FL1PPL Optical Delay Line (act)'
650 +FLASH.SYNC/LASER.LOCK.EXP/F1.PPL.OSC/FMC0.MD22.1.POSITION_SET.WR,'ps','FL1PPL Optical Delay Line (set)'
651 +FLASH.SYNC/LASER.LOCK.EXP/F1.PPL.OSC/FMC0.MD22.1.ENCODER_POSITION.RD,'ps','FL1PPL Optical Delay Line (Encoder Readback)'
652 +FLASH.FEL/FLAPPBEAMLINES.MOTOR/CAMP_Delayline/FPOS,'ps','FL1PPL NIR delay BL1 table (act)'
653 +FLASH.FEL/FLAPPBEAMLINES.MOTOR/CAMP_Delayline/FPOS.SET,'ps','FL1PPL NIR delay BL1 table (set)'
654 +FLASH.FEL/FLAPPBEAMLINES.MOTOR/CAMP.ATT/FPOS,'degree','FL1PPL Transmission degree (act)'
655 +FLASH.FEL/FLAPPBEAMLINES.MOTOR/CAMP.ATT/FPOS.SET,'degree','FL1PPL Transmission degree (set)'
656 +FLASH.FEL/FLAPPBEAMLINES.MOTOR/Camp_Focus_Lens/FPOS,'mm','FL1PPL Focus Mirror Stage Position (act)'
657 +FLASH.FEL/FLAPPBEAMLINES.MOTOR/Camp_Focus_Lens/FPOS.SET,'mm','FL1PPL Focus Mirror Stage Position (set)'
658 +FLASH.LASER/MODBL.FEEDFWD/BL1_Att/INPUT.Y,'%','FL1PPL Transmission rate'
659 +FLASH.SYNC/LASER.LOCK.EXP/F1.PPL.OSC/CURRENT_INPUT_JITTER.RD,'fs','FL1PPL Sync. Jitter'
660 +FLASH.SYNC/LASER.LOCK.EXP/F1.PPL.OSC/LOCK_STATUS.VALUE.RD,'au','FL1PPL Sync. Status'
639 639  
640 -
641 -
642 -{{/info}}
643 -
644 644  {{expand title="Parameters used until 2021"}}
645 645  {{code language="none"}}
646 646  /FL1/Experiment/Pump probe laser/laser attenuation
... ... @@ -923,8 +923,8 @@
923 923  (% style="letter-spacing:0.0px" %)units: (% class="twikiNewLink" %)MeV
924 924  
925 925  
926 -(% style="color: rgb(94, 108, 132); font-weight: 600; letter-spacing: 0px;" %)
927 -===== undulator settings =====
944 +(% style="color: rgb(94,108,132);font-weight: 600;letter-spacing: 0.0px;" %)
945 +undulator settings
928 928  
929 929  {{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
930 930  //always saved (PBD2)//
... ... @@ -976,7 +976,8 @@
976 976  desc: Electron bunch arrival time measured with the BAM  in the accelerator  (pulse resolved data)
977 977  units: ps (bigger numbers indicate later arrivaltime of the electrons)
978 978  
979 -{{info title="BAM hints"}}
997 +{{info title="
998 +BAM hints"}}
980 980  * The BAM 4DBC3 measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !).
981 981  * The BAM 8FL2XTDS measures only for FLASH2 BUT has the same data structure as the other BAMS ... thus there are also (random) values in in the  FLASH1 time slot 
982 982  ** Structure: The first values are for FLASH1 bunches. After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ... .In case of doubt ask your local contact
... ... @@ -1012,20 +1012,20 @@
1012 1012  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1013 1013  
1014 1014  
1015 -DBC2/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1034 +(% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1016 1016  //always saved (PBD)//
1017 -DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamError.2
1018 -DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.2
1019 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1036 +(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1037 +(% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel: {{/code}}(%%)
1038 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1020 1020  
1021 -DBC2/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1040 +
1041 +(% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1022 1022  //always saved (PBD)//
1023 -DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamStatus.//2//
1024 -DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2
1025 -desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1043 +(% style="color:#000000" %)E..bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1044 +(% style="color:#000000" %): FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ channel{{/code}}(%%)
1045 +desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1026 1026  
1027 1027  
1028 -
1029 1029  ====== **BAM FL2.SEED5**{{code language="none"}}{{/code}} ======
1030 1030  
1031 1031  /FL2/Electron Diagnostic/BAM/**SEED5**(% style="color:#ff6600" %)/electron bunch arrival time  (HDF5 name not yet implemented - see zraw)
... ... @@ -1050,17 +1050,18 @@
1050 1050  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1051 1051  
1052 1052  
1053 -FL2.SEED5/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1072 +(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1054 1054  //always saved (PBD)//
1055 -DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamError.2
1056 -DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMERROR.2
1057 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1074 +(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1075 +(% style="color:#000000" %): FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel{{/code}}(%%)
1076 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1058 1058  
1059 -FL2.SEED5/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1078 +
1079 +(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1060 1060  //always saved (PBD)//
1061 -DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamStatus.//2//
1062 -DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMSTATUS.2
1063 -desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1081 +(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1082 +(% style="color:#000000" %)el: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ chann{{/code}}(%%)
1083 +desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1064 1064  
1065 1065  
1066 1066  [[Contents>>doc:||anchor="Contents"]]
... ... @@ -1192,32 +1192,11 @@
1192 1192  
1193 1193  
1194 1194  
1195 -==== Pump Probe Laser (FLASH2) ====
1215 +==== FL 24 Pump Probe Laser (FLASH2) ====
1196 1196  
1197 -{{info width="30%"}}
1198 -list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
1199 -
1200 -[[attach:FSLADAQ-DAQParameterlistULGAN-2.pdf||target="_blank"]]
1201 -
1202 -[[attach:FSLADAQ-DAQParameterlistFL23-2.pdf||target="_blank"]]
1203 -
1204 -[[attach:FSLADAQ-DAQParameterlistFL24-2.pdf||target="_blank"]]
1205 -
1206 -
1207 -{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1208 -
1209 -
1210 -{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1211 -
1212 -
1213 -{{view-file att--filename="FSLADAQ-DAQParameterlistFL24-2.pdf"}}{{/view-file}}
1214 -
1215 -
1216 -{{/info}}
1217 -
1218 -{{expand title="Laser parameters used until 2023"}}
1219 1219  These are the parameters that can be saved in the FL2 User DAQ for the FL2 PP laser//** FOR BEAMLINE FL24**//
1220 1220  
1219 +
1221 1221  **User delay**
1222 1222  
1223 1223  Delay (set value):
... ... @@ -1571,10 +1571,11 @@
1571 1571  )))|(((
1572 1572  FLASH.LASER/ULGAN1.DYNPROP/TCFIBER.DOUBLES/DOUBLE26
1573 1573  )))
1574 -{{/expand}}
1575 1575  
1576 1576  
1575 +[[Contents>>doc:||anchor="Contents"]]
1577 1577  
1577 +
1578 1578  === "/uncategorized/" ===
1579 1579  
1580 1580   If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names
... ... @@ -1589,6 +1589,7 @@
1589 1589  * The ambigious term "pulse" has been replaced by "train" to refer to "pulse train". Most notably, the dataset "/Timing/pulse ID" has changed to "/Timing/train ID".
1590 1590  * A number of inconsistent names have been streamlined. The relevant changes are listed in the following table.
1591 1591  
1592 +
1592 1592  (% class="wrapped" %)
1593 1593  |=(((
1594 1594  earlier HDF path (vers. 0.2)
... ... @@ -1686,6 +1686,7 @@
1686 1686  /FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical
1687 1687  )))
1688 1688  
1690 +
1689 1689  [[Contents>>doc:||anchor="Contents"]]
1690 1690  
1691 1691  
FSLADAQ-DAQParameterlistFL23-2.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -32.1 KB
Content
FSLADAQ-DAQParameterlistFL24-2.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -37.6 KB
Content
FSLADAQ-DAQParameterlistFL24.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -37.2 KB
Content
FSLADAQ-DAQParameterlistPPlaser.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -33.9 KB
Content
FSLADAQ-DAQParameterlistPiGLET-300424-1356-986.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -157.0 KB
Content
FSLADAQ-DAQParameterlistPiGLET.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -157.0 KB
Content
FSLADAQ-DAQParameterlistULGAN-2.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -34.8 KB
Content
FSLADAQ-FL23.pdf
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -28.6 KB
Content
Screenshot 2024-05-17 094435.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sndueste
Size
... ... @@ -1,1 +1,0 @@
1 -172.4 KB
Content