Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55

From version 25.1
edited by sndueste
on 2019/10/21 17:03
Change comment: There is no comment for this version
To version 21.1
edited by sndueste
on 2019/09/18 10:29
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -36,26 +36,6 @@
36 36  
37 37  \\
38 38  
39 -== HDF5 example files ==
40 -
41 -Here we have a few HDF5 samples (User data combined with Photon diagnostics data) from a few beamtimes showing the different kind options.
42 -
43 -Example 1:  Images saved at FLASH2
44 -
45 -\\
46 -
47 -[[image:attach:image2019-10-21_17-2-50.png||thumbnail="true" height="150"]]
48 -
49 -\\
50 -
51 -\\
52 -
53 -[[Contents>>doc:||anchor="Contents"]]
54 -
55 -\\
56 -
57 -\\
58 -
59 59  == Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
60 60  
61 61  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
... ... @@ -99,7 +99,7 @@
99 99  //always saved (PBD)//
100 100  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
101 101  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
102 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
82 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
103 103  units: degree
104 104  \\
105 105  
... ... @@ -107,7 +107,7 @@
107 107  //always saved (PBD)//
108 108  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
109 109  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
110 -desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
90 +desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
111 111  units: degree
112 112  \\
113 113  
... ... @@ -157,7 +157,7 @@
157 157  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
158 158  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
159 159  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
160 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
140 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
161 161  
162 162  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}}
163 163  //always saved (PBD)//
... ... @@ -164,7 +164,7 @@
164 164  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}}
165 165  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}}
166 166  desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
167 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
147 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
168 168  
169 169  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
170 170  //always saved (PBD)//
... ... @@ -178,7 +178,7 @@
178 178  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
179 179  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
180 180  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
181 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
161 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
182 182  
183 183  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}}
184 184  //always saved (PBD)//
... ... @@ -185,7 +185,7 @@
185 185  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}}
186 186  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
187 187  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
188 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
168 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
189 189  
190 190  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
191 191  //always saved (PBD)//
... ... @@ -300,7 +300,7 @@
300 300  DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
301 301  desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
302 302  units: ps (bigger numbers indicate later arrivaltime of the electrons)
303 -note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
283 +note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
304 304  
305 305  ===== electron beam profile =====
306 306  
... ... @@ -561,13 +561,13 @@
561 561  //always saved (PBD2)//
562 562  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
563 563  DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
564 -desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
544 +desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]**
565 565  units: degree
566 566  \\
567 567  
568 568  
569 569  //always saved (PBD2)//
570 -\\\\**[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
550 +\\\\**[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]**
571 571  {{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2 DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}}
572 572  
573 573  \\
... ... @@ -609,7 +609,7 @@
609 609  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
610 610  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
611 611  desc : Energy per pulse measured in the Tunnel  (in fromt of the gas attenuator and the apertures in the Hall)
612 -units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
592 +units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]**
613 613  
614 614  \\
615 615  
... ... @@ -753,7 +753,7 @@
753 753  The BAM measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches.
754 754  After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ...
755 755  
756 -Docu for BAM:  [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
736 +Docu for BAM:  [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
757 757  
758 758  
759 759  [[Contents>>doc:||anchor="Contents"]]
... ... @@ -883,7 +883,7 @@
883 883  There may be more information available from the "Laser DAQ". laese contact your Laser Local Contact.
884 884  
885 885  
886 -{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/attenuator position{{/code}}//always saved (PBD2)//
866 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/laser attenuation{{/code}}//always saved (PBD2)//
887 887  DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
888 888  DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
889 889  desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
... ... @@ -892,9 +892,9 @@
892 892  \\
893 893  
894 894  
895 -{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/polarization position{{/code}}//always saved (PBD2)//
896 -DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
897 -DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
875 +{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/laser polarization{{/code}}//always saved (PBD2)//
876 +DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
877 +DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
898 898  desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
899 899  units : deg.
900 900  
... ... @@ -909,23 +909,225 @@
909 909  
910 910  \\
911 911  
912 -{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS{{/code}}
892 +\\
893 +
894 +{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO{{/code}}
913 913  //always saved (PBD)//
914 -DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
915 -DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
916 -desc: rms jitter of the fs-Oscillator
917 -units: fs
896 +DOOCS prop : {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}}
897 +DAQ channel: {{code language="none"}}FLASH.SYNC/F1PPL.LASER_LOCK/28C.F1PPL1.CONTROLLER/ADV_CTRL_MANAGER.0.PID_INPUT_JITTER.2.RD{{/code}}
898 +desc: rms jitter of the GECCO (% class="twikiNewLink" %)TiSa(%%) Oscillator units: fs
918 918  
900 +\\
901 +
902 +{{code language="none"}}/FL1/Experiment/Pump probe laser/streak camera delay time{{/code}}
903 +//always saved (PBD)//
904 +DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}}
905 +DOOCS prop : {{code language="none"}}TTF2.FEL/TDOLFEL/TDOLFEL/STREAK.CAM.TIME{{/code}}
906 +desc: delaytime between the optical laser and the FEL units: ps
907 +
908 +\\
909 +
919 919  [[Contents>>doc:||anchor="Contents"]]
920 920  
921 921  \\
922 922  
923 -=== "/uncategorized/" ===
914 +\\
924 924  
925 - If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names
916 +\\
926 926  
927 927  \\
928 928  
920 +(% class="wrapped" %)
921 +|=(((
922 +\\
923 +)))|=(((
924 +\\
925 +)))
926 +|(((
927 +\\
928 +)))|(((
929 +\\
930 +)))
931 +|(((
932 +\\
933 +)))|(((
934 +\\
935 +)))
936 +|(((
937 +\\
938 +)))|(((
939 +\\
940 +)))
941 +|(((
942 +\\
943 +)))|(((
944 +\\
945 +)))
946 +|(((
947 +\\
948 +)))|(((
949 +\\
950 +)))
951 +|(((
952 +\\
953 +)))|(((
954 +\\
955 +)))
956 +|(((
957 +\\
958 +)))|(((
959 +\\
960 +)))
961 +|(((
962 +\\
963 +)))|(((
964 +\\
965 +)))
966 +|(((
967 +\\
968 +)))|(((
969 +\\
970 +)))
971 +|(((
972 +\\
973 +)))|(((
974 +\\
975 +)))
976 +|(((
977 +\\
978 +)))|(((
979 +\\
980 +)))
981 +|(((
982 +\\
983 +)))|(((
984 +\\
985 +)))
986 +|(((
987 +\\
988 +)))|(((
989 +\\
990 +)))
991 +|(((
992 +\\
993 +)))|(((
994 +\\
995 +)))
996 +|(((
997 +\\
998 +)))|(((
999 +\\
1000 +)))
1001 +|(((
1002 +\\
1003 +)))|(((
1004 +\\
1005 +)))
1006 +|(((
1007 +\\
1008 +)))|(((
1009 +\\
1010 +)))
1011 +|(((
1012 +\\
1013 +)))|(((
1014 +\\
1015 +)))
1016 +|(((
1017 +\\
1018 +)))|(((
1019 +\\
1020 +)))
1021 +|(((
1022 +\\
1023 +)))|(((
1024 +\\
1025 +)))
1026 +|(((
1027 +\\
1028 +)))|(((
1029 +\\
1030 +)))
1031 +|(((
1032 +\\
1033 +)))|(((
1034 +\\
1035 +)))
1036 +|(((
1037 +\\
1038 +)))|(((
1039 +\\
1040 +)))
1041 +|(((
1042 +\\
1043 +)))|(((
1044 +\\
1045 +)))
1046 +|(((
1047 +\\
1048 +)))|(((
1049 +\\
1050 +)))
1051 +|(((
1052 +\\
1053 +)))|(((
1054 +\\
1055 +)))
1056 +|(((
1057 +\\
1058 +)))|(((
1059 +\\
1060 +)))
1061 +|(((
1062 +\\
1063 +)))|(((
1064 +\\
1065 +)))
1066 +|(((
1067 +\\
1068 +)))|(((
1069 +\\
1070 +)))
1071 +|(((
1072 +\\
1073 +)))|(((
1074 +\\
1075 +)))
1076 +|(((
1077 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD
1078 +)))|(((
1079 +/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS
1080 +)))
1081 +|(((
1082 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/LOCK_STATUS.VALUE.RD
1083 +)))|(((
1084 +/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO
1085 +)))
1086 +|(((
1087 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD
1088 +)))|(((
1089 +/FL2/Experiment/Pump probe laser/laser delay readback
1090 +)))
1091 +|(((
1092 +FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION_SET.WR
1093 +)))|(((
1094 +/FL2/Experiment/Pump probe laser/laser delay set value
1095 +)))
1096 +|(((
1097 +FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS
1098 +)))|(((
1099 +/FL2/Experiment/Pump probe laser/FL24/attenuator position
1100 +)))
1101 +|(((
1102 +FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/POS
1103 +)))|(((
1104 +/FL2/Experiment/Pump probe laser/FL24/polarization position
1105 +)))
1106 +
1107 +\\
1108 +
1109 +[[Contents>>doc:||anchor="Contents"]]
1110 +
929 929  === HDF5 structure revisions ===
930 930  
931 931  Starting with Beamblock 4, August 2018, the hierarchy of the HDF group names have been adapted to reflect the new situation at FLASH. FLASH2 is operating for users quite some time now. Therefore, both accelerators appear equally in their respective HDF groups, namely "/FL1" and "/FL2". The root group of proper, by run organised HDF files have an attribute called "version". This version attribute has changed from "0.2.x" to "0.3.x". The changes in detail: