Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 82.1
edited by sndueste
on 2024/05/17 10:13
Change comment: There is no comment for this version
To version 88.4
edited by sndueste
on 2025/02/06 10:54
Change comment: There is no comment for this version

Summary

Details

Page properties
Parent
... ... @@ -1,0 +1,1 @@
1 +FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).WebHome
Content
... ... @@ -10,9 +10,9 @@
10 10  
11 11  == General information about HDF5 ==
12 12  
13 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
13 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
14 14  
15 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
15 +To download the HDF5 Viewer click [[here>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
16 16  
17 17  For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module :
18 18  {{code language="none"}}> module load xray{{/code}}
... ... @@ -99,7 +99,7 @@
99 99  * The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below
100 100  * and for smaller projects:  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
101 101  
102 -(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
102 +(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
103 103  {{/info}}
104 104  {{/layout-cell}}
105 105  {{/layout-section}}
... ... @@ -110,7 +110,7 @@
110 110  
111 111  == Complete list of recordable parameters ==
112 112  
113 -The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
113 +The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
114 114  
115 115  
116 116  == Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
... ... @@ -402,8 +402,8 @@
402 402  =====
403 403  arrival time (BAM) =====
404 404  
405 -{{info title="BAM information: updates 2022"}}
406 -* see: [[Info collection about the BAMs and how to use the BAM data>>url:https://confluence.desy.de/display/FLASHUSER/Info+collection+for+the+BAM||shape="rect"]]
405 +{{info title="BAM information: updates 2022 (status 2025"}}
406 +* see: [[Info collection about the BAMs and how to use the BAM data>>doc:FLASHUSER.jddd-linked help pages.Info collection for the BAM.WebHome||shape="rect"]]
407 407  * The data format of the BAM has been completely altered in the 2022 shutdown
408 408  * before 2022 BAMs were always saving the arrival time information for each 1µs bucked regardless if there were electrons in the accelerator or not. IN addition the arrival times for  FL1 and FL2 were saved in the same parameter ...
409 409  * THIS is now different. There are new parameters saving only the arrival times for pulses that go to FL1 and to FL2 (in detail: first time slot of the accelerator and second)
... ... @@ -411,7 +411,7 @@
411 411  ** acc:  4DBC3 → FL0.DBC2
412 412  ** FL1: 1SFELC →  FL1.SFELC
413 413  ** FL2: FL2XTDS → (% style="color:#172b4d" %)FL2.SEED5
414 -* for more Info: [[LINK to detailed infos from MSK>>url:https://confluence.desy.de/display/SDiagPublic/BAM+Data+Structure||shape="rect"]]
414 +* for more Info: [[LINK to detailed infos from MSK>>doc:SDiag.How-to articles.BAM Data Structure.WebHome||shape="rect"]]
415 415  * [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments>>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]]
416 416  * a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
417 417  {{/info}}
... ... @@ -456,9 +456,9 @@
456 456  
457 457  (% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
458 458  //always saved (PBD)//
459 -DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError(%%)
460 -DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR(%%)
461 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
459 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError.1(%%)
460 +DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.1(%%)
461 +desc:(% style="letter-spacing:0.0px" %) status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
462 462  
463 463  
464 464  (% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
... ... @@ -630,13 +630,14 @@
630 630  
631 631  **{{code language="none"}}/FL1/Experiment/Pump probe laser{{/code}}**
632 632  
633 -{{info width="100"}}
633 +{{info width="30%"}}
634 634  list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
635 635  
636 -
637 637  Download the PDF:
638 638  
639 -[[~[~[image:Screenshot 2024-05-17 094435.png~|~|height="429" width="336"~]~]>>attach:FSLADAQ-DAQParameterlistPiGLET.pdf]]
638 +{{view-file att--filename="FSLADAQ-DAQParameterlistPiGLET.pdf"}}{{/view-file}}
639 +
640 +
640 640  
641 641  {{/info}}
642 642  
... ... @@ -922,8 +922,8 @@
922 922  (% style="letter-spacing:0.0px" %)units: (% class="twikiNewLink" %)MeV
923 923  
924 924  
925 -(% style="color: rgb(94,108,132);font-weight: 600;letter-spacing: 0.0px;" %)
926 -undulator settings
926 +(% style="color: rgb(94, 108, 132); font-weight: 600; letter-spacing: 0px;" %)
927 +===== undulator settings =====
927 927  
928 928  {{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
929 929  //always saved (PBD2)//
... ... @@ -1011,20 +1011,20 @@
1011 1011  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1012 1012  
1013 1013  
1014 -(% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1015 +DBC2/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1015 1015  //always saved (PBD)//
1016 -(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1017 -(% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel: {{/code}}(%%)
1018 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1017 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamError.2
1018 +DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.2
1019 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1019 1019  
1020 -
1021 -(% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1021 +DBC2/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1022 1022  //always saved (PBD)//
1023 -(% style="color:#000000" %)E..bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1024 -(% style="color:#000000" %): FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ channel{{/code}}(%%)
1025 -desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1023 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamStatus.//2//
1024 +DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2
1025 +desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1026 1026  
1027 1027  
1028 +
1028 1028  ====== **BAM FL2.SEED5**{{code language="none"}}{{/code}} ======
1029 1029  
1030 1030  /FL2/Electron Diagnostic/BAM/**SEED5**(% style="color:#ff6600" %)/electron bunch arrival time  (HDF5 name not yet implemented - see zraw)
... ... @@ -1049,18 +1049,17 @@
1049 1049  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1050 1050  
1051 1051  
1052 -(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1053 +FL2.SEED5/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1053 1053  //always saved (PBD)//
1054 -(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1055 -(% style="color:#000000" %): FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel{{/code}}(%%)
1056 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1055 +DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamError.2
1056 +DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMERROR.2
1057 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1057 1057  
1058 -
1059 -(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1059 +FL2.SEED5/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1060 1060  //always saved (PBD)//
1061 -(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1062 -(% style="color:#000000" %)el: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ chann{{/code}}(%%)
1063 -desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1061 +DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamStatus.//2//
1062 +DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMSTATUS.2
1063 +desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1064 1064  
1065 1065  
1066 1066  [[Contents>>doc:||anchor="Contents"]]
... ... @@ -1192,19 +1192,30 @@
1192 1192  
1193 1193  
1194 1194  
1195 -==== FL 24 Pump Probe Laser (FLASH2) ====
1195 +==== Pump Probe Laser (FLASH2) ====
1196 1196  
1197 -{{info}}
1197 +{{info width="30%"}}
1198 1198  list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
1199 1199  
1200 -[[attach:FSLADAQ-FL23.pdf||target="_blank"]]
1200 +[[attach:FSLADAQ-DAQParameterlistULGAN-2.pdf||target="_blank"]]
1201 1201  
1202 -[[attach:FSLADAQ-DAQParameterlistFL24.pdf||target="_blank"]]
1202 +[[attach:FSLADAQ-DAQParameterlistFL23-2.pdf||target="_blank"]]
1203 1203  
1204 -[[attach:FSLADAQ-DAQParameterlistPPlaser.pdf||target="_blank"]]
1205 -{{/info}}
1204 +[[attach:FSLADAQ-DAQParameterlistFL24-2.pdf||target="_blank"]]
1206 1206  
1207 1207  
1207 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1208 +
1209 +
1210 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1211 +
1212 +
1213 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL24-2.pdf"}}{{/view-file}}
1214 +
1215 +
1216 +{{/info}}
1217 +
1218 +{{expand title="Laser parameters used until 2023"}}
1208 1208  These are the parameters that can be saved in the FL2 User DAQ for the FL2 PP laser//** FOR BEAMLINE FL24**//
1209 1209  
1210 1210  **User delay**
... ... @@ -1560,8 +1560,8 @@
1560 1560  )))|(((
1561 1561  FLASH.LASER/ULGAN1.DYNPROP/TCFIBER.DOUBLES/DOUBLE26
1562 1562  )))
1574 +{{/expand}}
1563 1563  
1564 -[[Contents>>doc:||anchor="Contents"]]
1565 1565  
1566 1566  
1567 1567  === "/uncategorized/" ===
FSLADAQ-DAQParameterlistFL23-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +32.1 KB
Content
FSLADAQ-DAQParameterlistFL24-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +37.6 KB
Content
FSLADAQ-DAQParameterlistULGAN-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +34.8 KB
Content
URLShortener.Code.URLShortenerClass[0]