Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 80.1
edited by sndueste
on 2024/04/30 14:08
Change comment: There is no comment for this version
To version 88.3
edited by sndueste
on 2025/02/06 10:52
Change comment: There is no comment for this version

Summary

Details

Page properties
Parent
... ... @@ -1,0 +1,1 @@
1 +FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).WebHome
Content
... ... @@ -10,9 +10,9 @@
10 10  
11 11  == General information about HDF5 ==
12 12  
13 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
13 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
14 14  
15 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
15 +To download the HDF5 Viewer click [[here>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
16 16  
17 17  For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module :
18 18  {{code language="none"}}> module load xray{{/code}}
... ... @@ -99,7 +99,7 @@
99 99  * The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below
100 100  * and for smaller projects:  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
101 101  
102 -(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
102 +(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
103 103  {{/info}}
104 104  {{/layout-cell}}
105 105  {{/layout-section}}
... ... @@ -110,7 +110,7 @@
110 110  
111 111  == Complete list of recordable parameters ==
112 112  
113 -The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
113 +The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
114 114  
115 115  
116 116  == Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
... ... @@ -403,7 +403,7 @@
403 403  arrival time (BAM) =====
404 404  
405 405  {{info title="BAM information: updates 2022"}}
406 -* see: [[Info collection about the BAMs and how to use the BAM data>>url:https://confluence.desy.de/display/FLASHUSER/Info+collection+for+the+BAM||shape="rect"]]
406 +* see: [[Info collection about the BAMs and how to use the BAM data>>doc:FLASHUSER.jddd-linked help pages.Info collection for the BAM.WebHome||shape="rect"]]
407 407  * The data format of the BAM has been completely altered in the 2022 shutdown
408 408  * before 2022 BAMs were always saving the arrival time information for each 1µs bucked regardless if there were electrons in the accelerator or not. IN addition the arrival times for  FL1 and FL2 were saved in the same parameter ...
409 409  * THIS is now different. There are new parameters saving only the arrival times for pulses that go to FL1 and to FL2 (in detail: first time slot of the accelerator and second)
... ... @@ -456,9 +456,9 @@
456 456  
457 457  (% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
458 458  //always saved (PBD)//
459 -DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError(%%)
460 -DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR(%%)
461 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
459 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError.1(%%)
460 +DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.1(%%)
461 +desc:(% style="letter-spacing:0.0px" %) status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
462 462  
463 463  
464 464  (% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
... ... @@ -630,10 +630,15 @@
630 630  
631 631  **{{code language="none"}}/FL1/Experiment/Pump probe laser{{/code}}**
632 632  
633 -{{info}}
633 +{{info width="30%"}}
634 634  list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
635 635  
636 -[[attach:FSLADAQ-DAQParameterlistPiGLET.pdf||target="_blank"]]
636 +Download the PDF:
637 +
638 +{{view-file att--filename="FSLADAQ-DAQParameterlistPiGLET.pdf"}}{{/view-file}}
639 +
640 +
641 +
637 637  {{/info}}
638 638  
639 639  {{expand title="Parameters used until 2021"}}
... ... @@ -918,8 +918,8 @@
918 918  (% style="letter-spacing:0.0px" %)units: (% class="twikiNewLink" %)MeV
919 919  
920 920  
921 -(% style="color: rgb(94,108,132);font-weight: 600;letter-spacing: 0.0px;" %)
922 -undulator settings
926 +(% style="color: rgb(94, 108, 132); font-weight: 600; letter-spacing: 0px;" %)
927 +===== undulator settings =====
923 923  
924 924  {{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
925 925  //always saved (PBD2)//
... ... @@ -1007,20 +1007,20 @@
1007 1007  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1008 1008  
1009 1009  
1010 -(% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1015 +DBC2/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1011 1011  //always saved (PBD)//
1012 -(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1013 -(% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel: {{/code}}(%%)
1014 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1017 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamError.2
1018 +DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.2
1019 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1015 1015  
1016 -
1017 -(% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1021 +DBC2/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1018 1018  //always saved (PBD)//
1019 -(% style="color:#000000" %)E..bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1020 -(% style="color:#000000" %): FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ channel{{/code}}(%%)
1021 -desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1023 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamStatus.//2//
1024 +DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2
1025 +desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1022 1022  
1023 1023  
1028 +
1024 1024  ====== **BAM FL2.SEED5**{{code language="none"}}{{/code}} ======
1025 1025  
1026 1026  /FL2/Electron Diagnostic/BAM/**SEED5**(% style="color:#ff6600" %)/electron bunch arrival time  (HDF5 name not yet implemented - see zraw)
... ... @@ -1045,18 +1045,17 @@
1045 1045  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1046 1046  
1047 1047  
1048 -(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1053 +FL2.SEED5/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1049 1049  //always saved (PBD)//
1050 -(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1051 -(% style="color:#000000" %): FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel{{/code}}(%%)
1052 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1055 +DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamError.2
1056 +DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMERROR.2
1057 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1053 1053  
1054 -
1055 -(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1059 +FL2.SEED5/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1056 1056  //always saved (PBD)//
1057 -(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1058 -(% style="color:#000000" %)el: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ chann{{/code}}(%%)
1059 -desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1061 +DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamStatus.//2//
1062 +DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMSTATUS.2
1063 +desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1060 1060  
1061 1061  
1062 1062  [[Contents>>doc:||anchor="Contents"]]
... ... @@ -1188,19 +1188,30 @@
1188 1188  
1189 1189  
1190 1190  
1191 -==== FL 24 Pump Probe Laser (FLASH2) ====
1195 +==== Pump Probe Laser (FLASH2) ====
1192 1192  
1193 -{{info}}
1197 +{{info width="30%"}}
1194 1194  list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
1195 1195  
1196 -[[attach:FSLADAQ-FL23.pdf||target="_blank"]]
1200 +[[attach:FSLADAQ-DAQParameterlistULGAN-2.pdf||target="_blank"]]
1197 1197  
1198 -[[attach:FSLADAQ-DAQParameterlistFL24.pdf||target="_blank"]]
1202 +[[attach:FSLADAQ-DAQParameterlistFL23-2.pdf||target="_blank"]]
1199 1199  
1200 -[[attach:FSLADAQ-DAQParameterlistPPlaser.pdf||target="_blank"]]
1201 -{{/info}}
1204 +[[attach:FSLADAQ-DAQParameterlistFL24-2.pdf||target="_blank"]]
1202 1202  
1203 1203  
1207 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1208 +
1209 +
1210 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1211 +
1212 +
1213 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL24-2.pdf"}}{{/view-file}}
1214 +
1215 +
1216 +{{/info}}
1217 +
1218 +{{expand title="Laser parameters used until 2023"}}
1204 1204  These are the parameters that can be saved in the FL2 User DAQ for the FL2 PP laser//** FOR BEAMLINE FL24**//
1205 1205  
1206 1206  **User delay**
... ... @@ -1556,8 +1556,8 @@
1556 1556  )))|(((
1557 1557  FLASH.LASER/ULGAN1.DYNPROP/TCFIBER.DOUBLES/DOUBLE26
1558 1558  )))
1574 +{{/expand}}
1559 1559  
1560 -[[Contents>>doc:||anchor="Contents"]]
1561 1561  
1562 1562  
1563 1563  === "/uncategorized/" ===
FSLADAQ-DAQParameterlistFL23-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +32.1 KB
Content
FSLADAQ-DAQParameterlistFL24-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +37.6 KB
Content
FSLADAQ-DAQParameterlistULGAN-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +34.8 KB
Content
Screenshot 2024-05-17 094435.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +172.4 KB
Content
URLShortener.Code.URLShortenerClass[0]