Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55
From version 81.1
edited by sndueste
on 2024/05/17 09:47
Change comment: There is no comment for this version
To version 88.4
edited by sndueste
on 2025/02/06 10:54
Change comment: There is no comment for this version

Summary

Details

Page properties
Parent
... ... @@ -1,0 +1,1 @@
1 +FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).WebHome
Content
... ... @@ -10,9 +10,9 @@
10 10  
11 11  == General information about HDF5 ==
12 12  
13 -HDF5 is a data format maintained by the HDF group. For detailed general information see [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
13 +HDF5 is a data format maintained by the HDF group. For detailed general information see [[here>>url:https://portal.hdfgroup.org/display/support||shape="rect"]]
14 14  
15 -To download the HDF5 Viewer click [[here~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
15 +To download the HDF5 Viewer click [[here>>url:https://portal.hdfgroup.org/display/support/Download+HDFView||shape="rect"]]
16 16  
17 17  For use on the DESY Maxwell or PAL (max-fsc or pal) **hdfview** is available in the xray module :
18 18  {{code language="none"}}> module load xray{{/code}}
... ... @@ -99,7 +99,7 @@
99 99  * The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below
100 100  * and for smaller projects:  (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]
101 101  
102 -(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
102 +(% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]] and [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).DEMO - Working with FLASH data.WebHome]]
103 103  {{/info}}
104 104  {{/layout-cell}}
105 105  {{/layout-section}}
... ... @@ -110,7 +110,7 @@
110 110  
111 111  == Complete list of recordable parameters ==
112 112  
113 -The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|height="12" width="13"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
113 +The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
114 114  
115 115  
116 116  == Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
... ... @@ -402,8 +402,8 @@
402 402  =====
403 403  arrival time (BAM) =====
404 404  
405 -{{info title="BAM information: updates 2022"}}
406 -* see: [[Info collection about the BAMs and how to use the BAM data>>url:https://confluence.desy.de/display/FLASHUSER/Info+collection+for+the+BAM||shape="rect"]]
405 +{{info title="BAM information: updates 2022 (status 2025"}}
406 +* see: [[Info collection about the BAMs and how to use the BAM data>>doc:FLASHUSER.jddd-linked help pages.Info collection for the BAM.WebHome||shape="rect"]]
407 407  * The data format of the BAM has been completely altered in the 2022 shutdown
408 408  * before 2022 BAMs were always saving the arrival time information for each 1µs bucked regardless if there were electrons in the accelerator or not. IN addition the arrival times for  FL1 and FL2 were saved in the same parameter ...
409 409  * THIS is now different. There are new parameters saving only the arrival times for pulses that go to FL1 and to FL2 (in detail: first time slot of the accelerator and second)
... ... @@ -411,7 +411,7 @@
411 411  ** acc:  4DBC3 → FL0.DBC2
412 412  ** FL1: 1SFELC →  FL1.SFELC
413 413  ** FL2: FL2XTDS → (% style="color:#172b4d" %)FL2.SEED5
414 -* for more Info: [[LINK to detailed infos from MSK>>url:https://confluence.desy.de/display/SDiagPublic/BAM+Data+Structure||shape="rect"]]
414 +* for more Info: [[LINK to detailed infos from MSK>>doc:SDiag.How-to articles.BAM Data Structure.WebHome||shape="rect"]]
415 415  * [[Link a collection of papers related to the BAM and the analysis of pump-probe experiments>>doc:FLASHUSER.Additional helpful things.FLASH beamlines and instruments references.WebHome]]
416 416  * a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
417 417  {{/info}}
... ... @@ -456,9 +456,9 @@
456 456  
457 457  (% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
458 458  //always saved (PBD)//
459 -DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError(%%)
460 -DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR(%%)
461 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
459 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM(% style="color:#000000" %)E.bamError.1(%%)
460 +DAQ channel: (% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.1(%%)
461 +desc:(% style="letter-spacing:0.0px" %) status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
462 462  
463 463  
464 464  (% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL1/Electron Diagnostic/BAM/{{/code}}(%%)
... ... @@ -630,11 +630,14 @@
630 630  
631 631  **{{code language="none"}}/FL1/Experiment/Pump probe laser{{/code}}**
632 632  
633 -{{info}}
633 +{{info width="30%"}}
634 634  list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
635 635  
636 -[[~[~[image:Screenshot 2024-05-17 094435.png~|~|height="319" width="250"~]~]>>attach:FSLADAQ-DAQParameterlistPiGLET.pdf]]
636 +Download the PDF:
637 637  
638 +{{view-file att--filename="FSLADAQ-DAQParameterlistPiGLET.pdf"}}{{/view-file}}
639 +
640 +
638 638  
639 639  {{/info}}
640 640  
... ... @@ -920,8 +920,8 @@
920 920  (% style="letter-spacing:0.0px" %)units: (% class="twikiNewLink" %)MeV
921 921  
922 922  
923 -(% style="color: rgb(94,108,132);font-weight: 600;letter-spacing: 0.0px;" %)
924 -undulator settings
926 +(% style="color: rgb(94, 108, 132); font-weight: 600; letter-spacing: 0px;" %)
927 +===== undulator settings =====
925 925  
926 926  {{code language="none"}}/FL2/Electron Diagnostic/Undulator setting/set wavelength{{/code}}
927 927  //always saved (PBD2)//
... ... @@ -1009,20 +1009,20 @@
1009 1009  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1010 1010  
1011 1011  
1012 -(% style="color:#ff6600" %)DBC2/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1015 +DBC2/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1013 1013  //always saved (PBD)//
1014 -(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1015 -(% style="color:#000000" %)FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel: {{/code}}(%%)
1016 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1017 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamError.2
1018 +DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMERROR.2
1019 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1017 1017  
1018 -
1019 -(% style="color:#ff6600" %)DBC2/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1021 +DBC2/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1020 1020  //always saved (PBD)//
1021 -(% style="color:#000000" %)E..bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIM{{/code}}(%%)
1022 -(% style="color:#000000" %): FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ channel{{/code}}(%%)
1023 -desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1023 +DOOCS prop : FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.bamStatus.//2//
1024 +DAQ channel: FLASH.SDIAG/BAM/FL0.DBC2/ARRIVAL_TIME.BAMSTATUS.2
1025 +desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1024 1024  
1025 1025  
1028 +
1026 1026  ====== **BAM FL2.SEED5**{{code language="none"}}{{/code}} ======
1027 1027  
1028 1028  /FL2/Electron Diagnostic/BAM/**SEED5**(% style="color:#ff6600" %)/electron bunch arrival time  (HDF5 name not yet implemented - see zraw)
... ... @@ -1047,18 +1047,17 @@
1047 1047  units: fs (bigger numbers (typically) indicate later arrival times of the electrons).
1048 1048  
1049 1049  
1050 -(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/error (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1053 +FL2.SEED5/error (% style="color:#f39c12" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1051 1051  //always saved (PBD)//
1052 -(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamError{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1053 -(% style="color:#000000" %): FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMERROR{{code language="none"}}DAQ channel{{/code}}(%%)
1054 -desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1055 +DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamError.2
1056 +DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMERROR.2
1057 +desc: If the value is 0 , the BAM is working well. If it is non-zero there is a problem !!
1055 1055  
1056 -
1057 -(% style="color:#172b4d" %)SEED5(% style="color:#ff6600" %)/status  (HDF5 name not yet implemented - see zraw){{code language="none"}}/FL2/Electron Diagnostic/BAM/{{/code}}(%%)
1059 +FL2.SEED5/status  (% style="color:#e67e22" %)(HDF5 name not yet implemented - see zraw)(%%)/FL2/Electron Diagnostic/BAM/
1058 1058  //always saved (PBD)//
1059 -(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)E.bamStatus.//2//{{code language="none"}}DOOCS prop : FLASH.SDIAG/BAM//ARRIVAL_TIM{{/code}}(%%)
1060 -(% style="color:#000000" %)el: FLASH.SDIAG/BAM/(% style="color:#172b4d" %)**FL2.SEED5**(% style="color:#000000" %)/ARRIVAL_TIME.BAMSTATUS.2{{code language="none"}}DAQ chann{{/code}}(%%)
1061 -desc: status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1061 +DOOCS prop : FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.bamStatus.//2//
1062 +DAQ channel: FLASH.SDIAG/BAM/FL2.SEED5/ARRIVAL_TIME.BAMSTATUS.2
1063 +desc:  status bit: 0 - data is valid; 1 - beam present; 2 - calibration ongoing; 3 - feedback enabled; 4 - feedback acting;  mostly check for bit 0 == 1 is sufficient
1062 1062  
1063 1063  
1064 1064  [[Contents>>doc:||anchor="Contents"]]
... ... @@ -1190,19 +1190,30 @@
1190 1190  
1191 1191  
1192 1192  
1193 -==== FL 24 Pump Probe Laser (FLASH2) ====
1195 +==== Pump Probe Laser (FLASH2) ====
1194 1194  
1195 -{{info}}
1197 +{{info width="30%"}}
1196 1196  list of saved parameters status May 2024 (up to now the parameters can be found in /zraw/ ... )
1197 1197  
1198 -[[attach:FSLADAQ-FL23.pdf||target="_blank"]]
1200 +[[attach:FSLADAQ-DAQParameterlistULGAN-2.pdf||target="_blank"]]
1199 1199  
1200 -[[attach:FSLADAQ-DAQParameterlistFL24.pdf||target="_blank"]]
1202 +[[attach:FSLADAQ-DAQParameterlistFL23-2.pdf||target="_blank"]]
1201 1201  
1202 -[[attach:FSLADAQ-DAQParameterlistPPlaser.pdf||target="_blank"]]
1203 -{{/info}}
1204 +[[attach:FSLADAQ-DAQParameterlistFL24-2.pdf||target="_blank"]]
1204 1204  
1205 1205  
1207 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1208 +
1209 +
1210 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL23-2.pdf"}}{{/view-file}}
1211 +
1212 +
1213 +{{view-file att--filename="FSLADAQ-DAQParameterlistFL24-2.pdf"}}{{/view-file}}
1214 +
1215 +
1216 +{{/info}}
1217 +
1218 +{{expand title="Laser parameters used until 2023"}}
1206 1206  These are the parameters that can be saved in the FL2 User DAQ for the FL2 PP laser//** FOR BEAMLINE FL24**//
1207 1207  
1208 1208  **User delay**
... ... @@ -1558,8 +1558,8 @@
1558 1558  )))|(((
1559 1559  FLASH.LASER/ULGAN1.DYNPROP/TCFIBER.DOUBLES/DOUBLE26
1560 1560  )))
1574 +{{/expand}}
1561 1561  
1562 -[[Contents>>doc:||anchor="Contents"]]
1563 1563  
1564 1564  
1565 1565  === "/uncategorized/" ===
FSLADAQ-DAQParameterlistFL23-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +32.1 KB
Content
FSLADAQ-DAQParameterlistFL24-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +37.6 KB
Content
FSLADAQ-DAQParameterlistULGAN-2.pdf
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.sndueste
Size
... ... @@ -1,0 +1,1 @@
1 +34.8 KB
Content
URLShortener.Code.URLShortenerClass[0]