Changes for page The FLASH HDF5 structure

Last modified by sndueste on 2025/02/06 10:55

From 13.1 to 14.1 From 26.1 to 27.1

From version 14.1

edited by sndueste
on 2019/09/17 17:52

Change comment: There is no comment for this version

To version 26.1

edited by sndueste
on 2019/10/21 17:33

Change comment: There is no comment for this version

Raw
Rendered

Summary

Page properties (1 modified, 0 added, 0 removed)

Details

Page properties

Content

@@ -36,6 +36,26 @@
  \\
++== HDF5 example files ==
++
++Here we have a few HDF5 samples (User data combined with Photon diagnostics data) from a few beamtimes showing the different kind options.
++
++Example 1:  Images saved at FLASH2
++
++\\
++
++[[~[~[image:attach:image2019-10-21_17-2-50.png~|~|thumbnail="true" height="150"~]~]>>url:https://desycloud.desy.de/index.php/s/nyEgeCWJFC4gao2||shape="rect"]]
++
++\\
++
++\\
++
++[[Contents>>doc:||anchor="Contents"]]
++
++\\
++
++\\
++
  == Most popular FLASH parameters and their names in HDF5, DOOCS and (raw) DAQ ==
  The complete list for the relation between DOOCS names and HDF5 names for the recordable parameters can be found in [[DESY's Repository~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://stash.desy.de/projects/CS/repos/pah/browse/src/camp/data/channel2HdfName.dat||shape="rect"]].
@@ -79,7 +79,7 @@
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS1/FILTER1/FW.MOTOR.POS{{/code}}
--desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
++desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
  units: degree
  \\
@@ -87,7 +87,7 @@
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
  DAQ channel: {{code language="none"}}TTF2.FEL/BLFILTERS2/FILTER2/FW.MOTOR.POS{{/code}}
--desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
++desc: Position of the BL filter wheel 2 - to correlate with the filter material please look [[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]
  units: degree
  \\
@@ -137,7 +137,7 @@
  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT34/VAL{{/code}}
  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.USER{{/code}}
  desc :Energy per pulse Tunnel (from e-) - the values are set to "0" if there was no SASE beam in the FEL
--units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
++units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel (raw){{/code}}
  //always saved (PBD)//
@@ -144,7 +144,7 @@
  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT14/VAL{{/code}}
  DAQ channel: {{code language="none"}}PBD.PHFLUX/TUNNEL.ENERGYPULSE.FF{{/code}}
  desc :Energy per pulse Tunnel (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
--units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
++units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Average energy/energy BDA{{/code}}
  //always saved (PBD)//
@@ -158,7 +158,7 @@
  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT35/VAL{{/code}}
  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.USER{{/code}}
  desc :Energy per pulse BDA (from e-) - the values are set to "0" if there was no SASE beam in the FEL
--units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
++units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) **[[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Pulse resolved energy/energy BDA (raw){{/code}}
  //always saved (PBD)//
@@ -165,13 +165,13 @@
  DOOCS prop : {{code language="none"}}TTF2.DAQ/PHFLUX/OUT15/VAL{{/code}}
  DAQ channel: {{code language="none"}}PBD.PHFLUX/BDA.ENERGYPULSE.FF{{/code}}
  desc :Energy per pulse BDA (from e-) - uncorrected values. There are also values saved if there was no beam ... just background noise
--units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
++units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA horizontal{{/code}}
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IX.POS{{/code}}
--desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, x=horizontal)
++desc :Beam position of the photon Beam determined by the GMD (BDA, x=horizontal)
  units : mm
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position BDA vertical{{/code}}
@@ -178,7 +178,7 @@
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.BDA/IY.POS{{/code}}
--desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (BDA, y=vertical)
++desc :Beam position of the photon Beam determined by the GMD (BDA, y=vertical)
  units : mm
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel horizontal{{/code}}
@@ -185,7 +185,7 @@
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IX.POS{{/code}}
--desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, x=horizontal)
++desc :Beam position of the photon Beam determined by the GMD (TUNNEL, x=horizontal)
  units : mm
  {{code language="none"}}/FL1/Photon Diagnostic/GMD/Beam position/position tunnel vertical{{/code}}
@@ -192,7 +192,7 @@
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL1.TUNNEL/IY.POS{{/code}}
--desc :Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (TUNNEL, y=vertical)
++desc :Beam position of the photon Beam determined by the GMD (TUNNEL, y=vertical)
  units : mm
  {{code language="none"}}/FL1/Photon Diagnostic/Wavelength/Tunnelspectrometer/wavelength{{/code}}
@@ -280,7 +280,7 @@
  DAQ channel: {{code language="none"}}FLASH.SDIAG/BAM.DAQ/4DBC3.LOW_CHARGE_ARRIVAL_TIME{{/code}}
  desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
  units: ps (bigger numbers indicate later arrivaltime of the electrons)
--note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
++note: besides the arivaltime from FLASH1 there is also the FLASH2/3 electron arrival time saved. [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
  ===== electron beam profile =====
@@ -385,7 +385,7 @@
  //always saved (PBD)//
  DOOCS prop : {{code language="none"}}none{{/code}}
  DAQ channel: {{code language="none"}}none{{/code}}
--desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
++desc: Each 10 Hz burst has its unique train ID. For the HDF5 data set the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
  units:
  \\
@@ -392,7 +392,7 @@
  ===== Train time =====
  {{code language="none"}}/Timing/train time{{/code}}
--desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
++desc:Local time as array of day, hour, minute, second, and centisecond. This data set is meant for visualization purposes only. For correlations use the train ID or the Unix time of the time stamp
  units: d h min s cs
  \\
@@ -458,9 +458,15 @@
  ==== User Data (FLASH1) ====
++The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
++
++NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
++
++The most common and permanently installed device used by experiment are our ADCs:
++
  ===== GHz ADCs =====
--ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]
++ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
  //saved on DEMAND in the user DAQ//
  \\The HDF5 names for the ADC traces are depending on the beamline :
  \\PG Beamline:
@@ -483,14 +483,12 @@
  here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
  DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.PG/EXP1.CH00{{/code}}
--in addition there are also additional parameters saved like:
++In addition there are also additional parameters saved like:
--* sample frequency (in MHz)
--* error (state)
--* offset
++* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
++* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
++* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
--~|
--
  ===== MHz ADCs =====
  similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
@@ -498,10 +498,19 @@
  DOOCS prop : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02/CH00.TD
  DAQ channel: : FLASH.FEL/ADC.SIS.BL1/EXP1.CH02
--\\
++In addition there are also additional parameters saved like:
++* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
++* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
++
  [[Contents>>doc:||anchor="Contents"]]
++\\
++
++\\
++
++\\
++
  === FLASH2 ===
  There is analog to FLASH1 a permanently running "PhotonDagnostic DAQ FLASH2" (PBD2) and 2 User DAQs
@@ -509,11 +509,11 @@
  ==== Beamline info (FLASH2) ====
  (% style="color: rgb(255,153,0);" %)(not yet available){{code language="none"}}/FL2/Beamlines/Attenuator/pressure  {{/code}}(%%)
--//always saved (PBD2)//
--DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}}
--DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}}
--desc: set pressure in the gas attenuator
--units: mbar
++(% style="color: rgb(193,199,208);" %)//always saved (PBD2)// (%%)
++(% style="color: rgb(193,199,208);" %)DOOCS prop : {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
++(% style="color: rgb(193,199,208);" %)DAQ channel:  {{code language="none"}}FLASH.FEL/ATT.GAS_DOSING/FL2.HALL/PRESSURE{{/code}} (%%)
++(% style="color: rgb(193,199,208);" %)desc: set pressure in the gas attenuator (%%)
++(% style="color: rgb(193,199,208);" %)units: mbar(%%)
  \\
  {{code language="none"}}/FL2/Beamlines/FL20/Shutter/open{{/code}}
@@ -528,13 +528,13 @@
  //always saved (PBD2)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS{{/code}}
  DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR1.MOT3/FPOS
--desc: Position of the BL filter wheel 1 - to correlate with the filter material please look [[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
++desc: Position of the BL filter wheel 1 - to correlate with the filter material please look **[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
  units: degree
  \\
  //always saved (PBD2)//
--\\\\[[here>>doc:FLASH.Filter history (BL filterwheel 12)]]
++\\\\**[[here>>doc:FLASHUSER.jddd-linked help pages.Filter-Units.Filter wheels in FLASH1 and FLASH2.WebHome]]**
  {{code language="none"}}/FL2/Beamlines/Filter wheel/position wheel 2  DOOCS prop : FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS DAQ channel: FLASH.FEL/FL20H.PH.MOTOR/MOTOR2.MOT3/FPOS desc: Position of the BL filter wheel 2 - to correlate with the filter material please look units: degree{{/code}}
  \\
@@ -576,7 +576,7 @@
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL/INTENSITY.TD{{/code}}
  desc : Energy per pulse measured in the Tunnel  (in fromt of the gas attenuator and the apertures in the Hall)
--units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision) [[see here for help>>doc:FLASH.Calibrating the pulse resolved (electron) data from GMD]]
++units : a.u. (more or less µJ but need to be calibrated with the "Average energy" for good precision)** [[see here for help>>doc:FLASHUSER.jddd-linked help pages.Calibrating the pulse resolved (electron) data from GMD.WebHome]]**
  \\
@@ -604,7 +604,7 @@
  //always saved (PBD2)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS{{/code}}
--desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (tunnel, x=horizontal)
++desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
  units : mm
  \\
@@ -613,7 +613,7 @@
  //always saved (PBD2)//
  DOOCS prop : {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
  DAQ channel: {{code language="none"}}FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS{{/code}}
--desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the [[GMD>>doc:FLASH.Gas Monitor Detector]] (tunnel, x=horizontal)
++desc : the Average ( ~~ 20 sec averaging time ) Beam position of the photon Beam determined by the GMD (tunnel, x=horizontal)
  units : mm
  \\
@@ -631,9 +631,9 @@
  \\
--==== Photon Diagnostics OPIS[[ >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
++==== Photon Diagnostics OPIS[[  >>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]](FLASH2) ====
--for more info see: [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]
++for more info see:** [[ OPIS>>url:http://photon-science.desy.de/facilities/flash/photon_diagnostics/opis_spectrometer/index_eng.html||shape="rect"]]**
  (The OPIS hall is not installed yet ...)
@@ -670,7 +670,7 @@
  \\
--In case OPIS was not operating there is still informaton about the set wavelength for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
++In case OPIS was not operating there is still informaton about the **set wavelength** for the undulators (see below) which may differ by up to 5 % from the actual wavelength due to different settings in the FEL ...
  \\
@@ -684,7 +684,7 @@
  //always saved (PBD2)//
  DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
  DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2{{/code}}
--desc: electron bunch charge (FLASH2)
++desc: electron bunch charge FLASH2 (average value for each bunchtrain).
  units: nC
  \\
@@ -702,10 +702,10 @@
  //always saved (PBD2)//
  DOOCS prop : {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
  DAQ channel:  {{code language="none"}}FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP{{/code}}
--desc: Sgap value of the Undulators. this can be used to follow up how many undulators were closed and if there was a taper
++desc: gap value of the undulators. This can be used to follow up how many undulators were closed and if there was a taper
  units: mm
--The gap values are saved for all 12 undulators (Nr 3 to 14)
++The gap values are saved for all 12 undulators (Nr 3 to 14). Undulator 14 is the one closest to the experimental hall.
  =====
  arrival time =====
@@ -717,59 +717,43 @@
  desc: Electron bunch arrival time measured with the BAM (more or less) before the undulator (pulse resolved data)
  units: ps (bigger numbers indicate later arrivaltime of the electrons)
--The BAM measures the arrivaltime of FLASH 1 and FLASH2 in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches.
++The BAM measures the arrivaltime of** FLASH 1 and FLASH2** in the same data set (thus also sorted in at /FL1/ !). The first values are for FLASH1 bunches.
++After a gap of about 70 micros ( 70 colums)  with  as entry for the switching between FLASH 1 and 2 the values for the electrons used in FLASH2 start.  The start time of FLASH2 is also recorded in the DAQ. FLASH1 start time is for historic reasons 700. thus if e.g. the start time of FLASH2 ( property name see below) is 1200 it means that FLASH starts at column 500 (1200-700) ...
--\\
++Docu for BAM:  [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent [[talk about the working principle of the BAM>>attach:BAM-basics and outlook-2018_DESY-template_16-9Format.pdf]]
--first bunch of FLASH2 ... how to calculate ..
--\\
++[[Contents>>doc:||anchor="Contents"]]
  \\
--Docu:  [[LINK to detailled infos from MSK (may only work inside DESY network~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:http://www.desy.de/~~mbock/pages/BAM_daq_channel_descriptions.html||shape="rect"]] and to a recent  [[talk about the working principle of the BAM>>url:https://confluence.desy.de/download/attachments/134216957/BAM-basics_and_outlook-2018_DESY-template_16-9Format.pdf?version=1&modificationDate=1565162143328&api=v2||shape="rect"]]
++==== Timing information, rep rate etc.  (FLASH2) ====
--\\
++===== start time of FLASH2 =====
--\\
++{{code language="none"}}/FL2/Timing/start time flash2{{/code}}
++//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
++DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/BUNCH_POSITION.2{{/code}}
++desc: The max 600 µs acceleration time of FLASH is devided between FLASH1 and FLASH2. This 600 µs window starts with FLASH1 (up to now)  at a time"label" of 700 µs (for historic reasons). Thus the first bunch of FLASH 1 comes at "700" and the last possibel bunch comes at 1300 (700+600). After FLASH1 train is over ther is a about 70µs switching time with no bunches. Then comes the first FLASH2 bunch.  Thus if e.g. the start time of FLASH2 is 1200 it means that FLASH2 starts at column 500 (1200-700)  in the HDF5 files. (However for yet unknown reasons this may change by 2-3 colums ...)
++units: µs
--\\
--
--
--\\
--
--[[Contents>>doc:||anchor="Contents"]]
--
--\\
--
--==== Timing information, rep rate etc.  (FLASH1) ====
--
  ===== bunch repetition rate =====
--{{code language="none"}}/FL1/Timing/repetition rate{{/code}}
--//always saved (PBD)//
--DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.1{{/code}}
--DAQ channel: {{code language="none"}}TTF2.UTIL/LASER.CONTROL/GUN/PULSE_FREQ{{/code}}
--desc: repetition rate of the bunches / pulses within the burst (FLASH1)
++{{code language="none"}}/FL2/Timing/repetition rate{{/code}}
++//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
++DAQ channel: {{code language="none"}}FLASH.DIAG/TIMER/FLASHCPUTIME1.0/REP_RATE_KHZ.2{{/code}}
++desc: repetition rate of the bunches / pulses within the burst (FLASH2)
  units: kHz
--\\
--===== set number of pulses =====
--
--{{code language="none"}}/FL1/Timing/set number of bunches{{/code}}
--//always saved (PBD)//
--DOOCS prop : {{code language="none"}}FLASH.DIAG/TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH1{{/code}}
--DAQ channel: {{code language="none"}}TTF2.UTIL/LASER.CONTROL/GUN/PULSE_NUM{{/code}}
--desc: Number of pulses set at the gun (FLASH1)
--units:
--
  ===== actual number of pulses =====
  {{code language="none"}}/FL1/Timing/actual number of bunches{{/code}}
--//always saved (PBD)//
--DOOCS prop : {{code language="none"}}FLASH.DIAG/TOROID.ML/12EXP/NUMBEROFBUNCHES.FLASH1{{/code}}
--DAQ channel: {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP{{/code}}
--desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH1)
++//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
++DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/3GUN/NUMBEROFBUNCHES.FLASH2{{/code}}
++desc: Number of bunches measured BEHIND the undulator. If pulses are used for diagnostic of the protection system of the accelerator limits the number of bunches to be accelerated this is the actual number that created XUV radiation.The number is calculated by the DAQ middle layer server, (FLASH2)
  units:
  \\
@@ -776,10 +776,10 @@
  ===== actual pulse pattern recorded after the undulator =====
  {{code language="none"}}/FL1/Timing/Bunch pattern/pattern after undulator{{/code}}
--//always saved (PBD)//
--DOOCS prop : {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP/CHARGE.TD{{/code}}
--DAQ channel: {{code language="none"}}TTF2.DIAG/PBD.TOROID.ML/12EXP{{/code}}
--desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH1)
++//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
++DAQ channel: {{code language="none"}}FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN.PULSEPATTERN{{/code}}
++desc: The bunch pattern as function of time in a burst recorded by toroide diagnostic BEHIND the undulator. (FLASH2)
  units:
  \\
@@ -786,7 +786,7 @@
  ===== Train ID =====
  {{code language="none"}}/Timing/train ID{{/code}}
--//always saved (PBD)//
++//always saved (PBD2)//
  DOOCS prop : {{code language="none"}}none{{/code}}
  DAQ channel: {{code language="none"}}none{{/code}}
  desc: Each 10 Hz burst has its unique train ID. For the HDF5 dataset the ID is the same for all parameters with the same index (note camera images may be shifted by 1 ID - talk to the experts !)
@@ -795,13 +795,16 @@
  ===== Train time =====
--{{code language="none"}}/Timing/train time{{/code}}
++//always saved (PBD2)
++//{{code language="none"}}/Timing/train time{{/code}}
  desc:Local time as array of day, hour, minute, second, and centisecond. This dataset is meant for visualisation purposes only. For correlations use the train ID or the Unix time of the time stamp
  units: d h min s cs
  \\
--{{code language="none"}}/Timing/time stamp{{/code}}
--desc:first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
++{{code language="none"}}/Timing/time stamp{{/code}}
++
++//always saved (PBD2)//
++desc: first column: Local time in unix time. To get day, hour, minute, second you can use unix: e.g. date ~-~-date='@1553617729' or matlab, python etc
  second column: microseconds
  third column: Train ID of FLASH
  \\
@@ -810,209 +810,102 @@
  \\
--\\
++==== User Data (FLASH2) ====
++The data saved specifically for detectors at an experiment will show up in /Experiment/ there is a large number of options for cameras or monitoring pslow properties (motor positons etc) for user experiments. For details please ask your local contact.
++
++NOTE: If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with the DOOCS names
++
++The most common and permanently installed device used by experiment are our ADCs:
++
++===== GHz ADCs =====
++
++ADC traces of the (SPDevices 412) GHZ ADCs available for the users . More information about the ADCs can be found** [[here>>doc:FLASHUSER.Data Acquisition and controls.Controls (DOOCS, jDDD,\.\.\.).MTCA ADCs.WebHome]]**
++//saved on DEMAND in the user DAQ//
++\\Up to now there are 4 channels available at FL24
++\\\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD{{/code}}
++{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH01/TD{{/code}}
++\\{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH02/TD{{/code}}{{code language="none"}}/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH03/TD{{/code}}
++
  \\
++DOOCS prop : {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00/CH00.TD  or CH00.DAQ.TD{{/code}}
++here the {{code language="none"}}CH00.TD{{/code}} is the full ADC trace as it is sampled ( typically several 100.000 samples per pulse train) while the {{code language="none"}}CH00.DAQ.TD{{/code}} trace only has the number of samples which are sent to the DAQ OR if //grouping// is activated the {{code language="none"}}CH00.DAQ.TD{{/code}} conatins only the grouped spectra. To read the ADC trace with an online analysis program the {{code language="none"}}CH00.DAQ.TD{{/code}} is used preferablly.
++DAQ channel: {{code language="none"}}FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00{{/code}}
++
++In addition there are also additional parameters saved like:
++
++* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
++* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
++* {{code language="none"}}error (ADC):{{/code}} 0 indicates that there was no error
++* {{code language="none"}}/CH0-CH3/offset{{/code}}: To use the full dynamic range of the ADC one can shift the base line . This offset is saved here.
++
++===== MHz ADCs =====
++
++similar to the GHz ADCs the MHz ADCs are saved with HDF5 names like:
++{{code language="none"}}/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH2/TD{{/code}}
++DOOCS prop : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02/CH00.TD
++DAQ channel: : FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH02
++
++In addition there are also additional parameters saved like:
++
++* {{code language="none"}}sample frequency{{/code}}: it shows the sample frequency in MHz (number of samples per µs). NOTE: the clock of the ADC is NOT synchronized to the FLASH timing system. Thus the number of samples between bunches in the bunch train may be not integer numbers which will be show up for long bunch trains.
++* {{code language="none"}}number of samples{{/code}}: total number of samoles recorded for each 10 Hz trigger
++
++[[Contents>>doc:||anchor="Contents"]]
++
  \\
  \\
++==== Pump Probe Laser (FLASH2) ====
++
++There may be more information available from the "Laser DAQ". laese contact your Laser Local Contact.
++
++
++{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/attenuator position{{/code}}//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
++DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS{{/code}}
++desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
++units : deg.
++
  \\
++
++{{code language="none"}}/FL2/Experiment/Pump probe laser/FL24/polarization position{{/code}}//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
++DAQ channel: {{code language="none"}}FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/FPOS{{/code}}
++desc: attenuation of the PPLaser in the FL24 hutch (rotation of a waveplate)
++units : deg.
++
  \\
--(% class="wrapped" %)
--|=(((
--DAQ name
--)))|=(((
--HDF5 name
--)))
--|(((
--FLASH.UTIL/FL2.UND.MOTOR/FL2SASE3/GAP
--)))|(((
--/FL2/Electron Diagnostic/Undulator setting/SASE03 gap
--)))
--|(((
--FLASH.UTIL/FL2.UND.MOTOR/FL2SASE14/GAP
--)))|(((
--/FL2/Electron Diagnostic/Undulator setting/SASE14 gap
--)))
--|(((
--TTF2.FEEDBACK/FL2.WAVELENGTHCONTROL/FLASH2/WAVELENGTH
--)))|(((
--/FL2/Electron Diagnostic/Undulator setting/set wavelength
--)))
--|(((
--FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX.UJ
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average energy/hall
--)))
--|(((
--FLASH.FEL/XGM.PHOTONFLUX/FL2.HALL/PHOTONFLUX
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average energy/hall (raw)
--)))
--|(((
--FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX.UJ
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average energy/tunnel
--)))
--|(((
--FLASH.FEL/XGM.PHOTONFLUX/FL2.TUNNEL/PHOTONFLUX
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average energy/tunnel (raw)
--)))
--|(((
--FLASH.FEL/XGM.POSMON/FL2.HALL/IX.POS
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average beam position/position hall horizontal
--)))
--|(((
--FLASH.FEL/XGM.POSMON/FL2.HALL/IY.POS
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average beam position/position hall vertical
--)))
--|(((
--FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IX.POS
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel horizontal
--)))
--|(((
--FLASH.FEL/XGM.POSMON/FL2.TUNNEL/IY.POS
--)))|(((
--/FL2/Photon Diagnostic/GMD/Average beam position/position tunnel vertical
--)))
--|(((
--FLASH.FEL/XGM.BPM/FL2.HALL:0
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall horizontal
--)))
--|(((
--FLASH.FEL/XGM.BPM/FL2.HALL:1
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position hall vertical
--)))
--|(((
--FLASH.FEL/XGM.BPM/FL2.TUNNEL:0
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel horizontal
--)))
--|(((
--FLASH.FEL/XGM.BPM/FL2.TUNNEL:1
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved beam position/position tunnel vertical
--)))
--|(((
--FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:1
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy aux tunnel
--)))
--|(((
--FLASH.FEL/XGM.INTENSITY/FL2.HALL
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
--)))
--|(((
--FLASH.FEL/XGM.INTENSITY/FL2.HALL:0
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy hall
--)))
--|(((
--FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
--)))
--|(((
--FLASH.FEL/XGM.INTENSITY/FL2.TUNNEL:0
--)))|(((
--/FL2/Photon Diagnostic/GMD/Pulse resolved energy/energy tunnel
--)))
--|(((
--FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL042
--)))|(((
--/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean phtoton energy
--)))
--|(((
--FLASH.UTIL/STORE/FL2.TUNNEL.OPIS/VAL040
--)))|(((
--/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Processed/mean wavelengt
--)))
--|(((
--FLASH.FEL/ADC.ADQ/OPIS1.CH02
--)))|(((
--/FL2/Photon Diagnostic/Wavelength/OPIS tunnel/Raw data/CH02
--)))
--|(((
--FLASH.DIAG/PBD2.TOROID.ML/9FL2BURN/CHARGE.FLASH2
--)))|(((
--/FL2/Electron Diagnostic/Bunch charge/after undulator
--)))
--|(((
--FLASH.DIAG/PBD2.TOROID.ML/3GUN/CHARGE.FLASH2
--)))|(((
--/FL2/Electron Diagnostic/Bunch charge/at gun
--)))
--|(((
--FLASH.FEL/FL20T.PH.MOTOR/MOTOR1.MOT1/FPOS
--)))|(((
--/FL2/Beamlines/Tunnel Apertures/position aperture1 horizontal
--)))
--|(((
--FLASH.FEL/FL20T.PH.MOTOR/MOTOR2.MOT1/FPOS
--)))|(((
--/FL2/Beamlines/Tunnel Apertures/position aperture1 vertical
--)))
--|(((
--FLASH.FEL/ADC.SIS.FL2FS/FL20.SHUTTER
--)))|(((
--/FL2/Beamlines/FL20/Shutter/channel 0
--)))
--|(((
--FLASH.FEL/ADC.ADQ.FL2EXP1/FL2EXP1.CH00
--)))|(((
--/FL2/Experiment/MTCA-EXP1/ADQ412 GHz ADC/CH00/TD
--)))
--|(((
--FLASH.FEL/ADC.SIS.FL2EXP1/FL2EXP1.CH00
--)))|(((
--/FL2/Experiment/MTCA-EXP1/SIS8300 100MHz ADC/CH0/TD
--)))
--|(((
--FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD
--)))|(((
--/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS
--)))
--|(((
--FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/LOCK_STATUS.VALUE.RD
--)))|(((
--/FL2/Experiment/Pump probe laser/Synchronization/timing jitter RMS GECCO
--)))
--|(((
--FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD
--)))|(((
--/FL2/Experiment/Pump probe laser/laser delay readback
--)))
--|(((
--FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION_SET.WR
--)))|(((
--/FL2/Experiment/Pump probe laser/laser delay set value
--)))
--|(((
--FLASH.FEL/FLAPP2BEAMLINES/MOTOR1.FL24/FPOS
--)))|(((
--/FL2/Experiment/Pump probe laser/FL24/attenuator position
--)))
--|(((
--FLASH.FEL/FLAPP2BEAMLINES/MOTOR2.FL24/POS
--)))|(((
--/FL2/Experiment/Pump probe laser/FL24/polarization position
--)))
++{{code language="none"}}/FL1/Experiment/Pump probe laser/laser delay readback{{/code}}
++//always saved (PBD2)//
++DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}}
++DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/FMC0.MD22.0.POSITION.RD{{/code}}
++desc: delay of the Pump probe laser - measured by the read back position of the motor. There is also the set value available ( upto now these values are only updating every 1-2 seconds. There is no fast encoder property as on FLASH1 available)
++units : ps )
  \\
++{{code language="none"}}/FL1/Experiment/Pump probe laser/Synchronization/timing jitter RMS{{/code}}
++//always saved (PBD)//
++DOOCS prop : {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
++DAQ channel: {{code language="none"}}FLASH.SYNC/LASER.LOCK.EXP/FLASH2.PPL1.OSC1/CURRENT_INPUT_JITTER.RD{{/code}}
++desc: rms jitter of the fs-Oscillator
++units: fs
++
  [[Contents>>doc:||anchor="Contents"]]
++\\
++
++=== "/uncategorized/" ===
++
++ If parameters for an experiment are included on short notice the correct naming in the HDF5 may not be in time and the data will show up in /uncategorized/ with their DOOCS names
++
++\\
++
  === HDF5 structure revisions ===
  Starting with Beamblock 4, August 2018, the hierarchy of the HDF group names have been adapted to reflect the new situation at FLASH. FLASH2 is operating for users quite some time now. Therefore, both accelerators appear equally in their respective HDF groups, namely "/FL1" and "/FL2". The root group of proper, by run organised HDF files have an attribute called "version". This version attribute has changed from "0.2.x" to "0.3.x". The changes in detail:

Changes for page The FLASH HDF5 structure

Summary

Details

Applications

Navigation