Changes for page DEMO - Working with FLASH data
Last modified by makuadm on 2026-01-07 06:21
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. cpassow1 +XWiki.sndueste - Content
-
... ... @@ -1,5 +1,36 @@ 1 -test 1 +Experimental data is recorded as HDF files[link] on the GPFS file system[link]. The access rights[link to ACLs] are linked to the user's DESY account and can be managed by the PI via the GAMMA portal[link]. The experimental data can be downloaded via the GAMMA portal, but it is advised to use the DESY computing infrastructure. Access point are via ssh[link], Maxwell-Display Server[link] or JuyterHub[link]. We recommmend using the JupyterHub for data exploration and the SLURM resources[link] for high performances computing. 2 2 3 +For simplified acccess we provide a conda module flashh5[link] which can be installed in a personal conda environment[link] on the Maxwell Cluster. Example on the usage can be found here [link - repo + binder] 4 + 5 +\\ 6 + 7 +{{expand title="How to login JupyterHub"}} 8 + 9 + 10 +{{view-file att--filename="tmp.mp4" height="250"/}} 11 +{{/expand}} 12 + 13 +\\ 14 + 15 +\\ 16 + 17 +{{info}} 18 +=== There are different options that help you to work with the FLASH HDF5 data in Python === 19 + 20 +The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below 21 + 22 +and for smaller projects: (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]] 23 +{{/info}} 24 + 25 +\\ 26 + 27 +[[~[~[image:attach:image2023-9-29_11-1-37.png~]~]>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] 28 + 29 +\\ 30 + 31 +{{expand title="older ideas ..."}} 32 +(% class="Object" %)(object oriented) [[https:~~/~~/gitlab.desy.de/christopher.passow/fdh-builder>>url:https://gitlab.desy.de/christopher.passow/fdh-builder.git||shape="rect"]] 33 + 3 3 ---- 4 4 5 5 === TODO === ... ... @@ -17,6 +17,18 @@ 17 17 GPFS 18 18 {{/task}} 19 19 51 +{{task reference="/Tasks/Task_40" status="InProgress"}} 52 +Access rights 53 +{{/task}} 54 + 55 +{{task reference="/Tasks/Task_41" status="InProgress"}} 56 +Gamma Portal 57 +{{/task}} 58 + 59 +{{task reference="/Tasks/Task_42" status="InProgress"}} 60 +Maxwell 61 +{{/task}} 62 + 20 20 {{task reference="/Tasks/Task_20" status="InProgress"}} 21 21 JupyterHub 22 22 {{/task}} ... ... @@ -197,3 +197,6 @@ 197 197 {{/code}} 198 198 199 199 \\ 243 + 244 +\\ 245 +{{/expand}}