Skip to Content
Last modified by makuadm on 2026-01-07 06:21
From version 41.3
edited by sndueste
on 2025-02-05 14:41
Change comment: There is no comment for this version
To version 41.2
edited by sndueste
on 2025-02-05 11:21
Change comment: Update document after refactoring.

Summary

Details

Page properties
Content
... ... @@ -1,4 +1,4 @@
1 -Experimental data is recorded as HDF files[[~[link~]>>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]] on the GPFS file system[[~[link~]>>doc:ASAP3.ASAP3 Data Storage for PETRA III]]. The access rights are linked to the user's DESY account and can be managed by the PI via the GAMMA portal[[~[link~]>>url:https://gamma-portal.desy.de/||shape="rect"]]. The experimental data can be downloaded via the GAMMA portal, but it is advised to use the DESY computing infrastructure. Access point are via ssh, Maxwell-Display Server[[~[link~]>>url:https://confluence.desy.de/display/MXW/Maxwell+Cluster||shape="rect"]] or JuyterHub[[~[link~]>>url:https://confluence.desy.de/display/MXW/JupyterHub+on+Maxwell||shape="rect"]]. We recommend using the JupyterHub for data exploration and the SLURM resources for high performances computing - see FAB for easy usage of the infrastructure.
1 +Experimental data is recorded as HDF files[[~[link~]>>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]] on the GPFS file system[[~[link~]>>doc:ASAP3.ASAP3 Data Storage for PETRA III]]. The access rights are linked to the user's DESY account and can be managed by the PI via the GAMMA portal[[~[link~]>>url:https://gamma-portal.desy.de/||shape="rect"]]. The experimental data can be downloaded via the GAMMA portal, but it is advised to use the DESY computing infrastructure. Access point are via ssh, Maxwell-Display Server[[~[link~]>>url:https://confluence.desy.de/display/MXW/Maxwell+Cluster||shape="rect"]] or JuyterHub[[~[link~]>>url:https://confluence.desy.de/display/MXW/JupyterHub+on+Maxwell||shape="rect"]]. We recommend using the JupyterHub for data exploration and the SLURM resources for high performances computing - see FAB for easy usage of the infrastructure.
2 2  
3 3  {{info title="How to login JupyterHub"}}
4 4  === ===
... ... @@ -6,6 +6,8 @@
6 6  {{view-file att--filename="tmp.mp4" height="150"/}}
7 7  {{/info}}
8 8  
9 +\\
10 +
9 9  {{info}}
10 10  === There are different options that help you to work with the FLASH HDF5 data in Python ===
11 11  
... ... @@ -15,9 +15,12 @@
15 15  (% class="Object" %)See also the collection of Demo data and sample scripts : [[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).Collection of HDF5 sample data from different beamlines.WebHome]]
16 16  {{/info}}
17 17  
20 +\\
18 18  
19 19  [[~[~[image:attach:image2023-9-29_11-1-37.png~]~]>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]]
20 20  
24 +\\
25 +
21 21  {{expand title="older ideas ..."}}
22 22  (% class="Object" %)(object oriented) [[https:~~/~~/gitlab.desy.de/christopher.passow/fdh-builder>>url:https://gitlab.desy.de/christopher.passow/fdh-builder.git||shape="rect"]]
23 23  
... ... @@ -28,7 +28,7 @@
28 28  (% class="task-list" %)
29 29  (((
30 30  {{task reference="/Tasks/Task_18" status="InProgress"}}
31 -Short descriptions including Links:   → as Text
36 +Short descriptions including Links:   → as Text\\
32 32  
33 33  (% class="task-list" %)
34 34  (((
... ... @@ -65,6 +65,7 @@
65 65  {{/task}}
66 66  )))
67 67  
73 +\\
68 68  
69 69  (% class="task-list" %)
70 70  (((
... ... @@ -86,6 +86,7 @@
86 86  {{/task}}
87 87  )))
88 88  
95 +\\
89 89  
90 90  (% class="task-list" %)
91 91  (((
... ... @@ -103,6 +103,7 @@
103 103  {{/task}}
104 104  )))
105 105  
113 +\\
106 106  
107 107  (% class="task-list" %)
108 108  (((
... ... @@ -120,6 +120,7 @@
120 120  {{/task}}
121 121  )))
122 122  
131 +\\
123 123  
124 124  (% class="task-list" %)
125 125  (((
... ... @@ -153,12 +153,15 @@
153 153  {{/task}}
154 154  )))
155 155  
165 +\\
156 156  
167 +\\
157 157  
158 158  ----
159 159  
160 160  ==== under review ====
161 161  
173 +\\
162 162  
163 163  {{code language="bash"}}
164 164  conda create -n flashh5 python=3.10 # 3.10 not necessary, but would prefer 3.8 or higher
... ... @@ -175,8 +175,9 @@
175 175  ## delete from: /home/$USER/.local/share/jupyter/kernels/
176 176  {{/code}}
177 177  
178 -{{code language="py" title="
179 -moved to repository?"}}
190 +\\
191 +
192 +{{code language="py" title="moved to repository?"}}
180 180  class RunDirectory:
181 181  
182 182   def get_run_table(): # more or less information? RunComment | Number of Files | start & stop time ?
... ... @@ -221,6 +221,7 @@
221 221  # run.to_xarray(daq_map)
222 222  {{/code}}
223 223  
237 +\\
224 224  
225 -
239 +\\
226 226  {{/expand}}