Changes for page DEMO - Working with FLASH data
Last modified by makuadm on 2026-01-07 06:21
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki.s ndueste1 +XWiki.cpassow - Content
-
... ... @@ -1,30 +1,17 @@ 1 - Experimental data is recorded asHDF files[[~[link~]>>doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]] on the GPFS file system[[~[link~]>>doc:ASAP3.ASAP3 Data Storage for PETRA III]]. The access rights are linked to the user's DESY account and can be managed by the PI via the GAMMA portal[[~[link~]>>url:https://gamma-portal.desy.de/||shape="rect"]]. The experimental data can be downloaded via the GAMMA portal, but it is advised to use the DESY computing infrastructure. Access point are via ssh, Maxwell-Display Server[[~[link~]>>url:https://confluence.desy.de/display/MXW/Maxwell+Cluster||shape="rect"]] or JuyterHub[[~[link~]>>url:https://confluence.desy.de/display/MXW/JupyterHub+on+Maxwell||shape="rect"]]. We recommend using the JupyterHub for data exploration and the SLURM resources for high performances computing - see FAB for easy usage of the infrastructure.1 +test 2 2 3 -{{info title="How to login JupyterHub"}} 4 -=== === 5 - 6 -{{view-file att--filename="tmp.mp4" height="150"/}} 7 -{{/info}} 8 - 9 9 \\ 10 10 11 -{{info}} 12 -=== There are different options that help you to work with the FLASH HDF5 data in Python === 5 +{{expand}} 13 13 14 -The currently developed option for large data sets: [[the FAB package>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] ... see below 15 15 16 - andfor smallerprojects: (% class="Object" %)[[https:~~/~~/gitlab.desy.de/christopher.passow/flash-daq-hdf>>url:https://gitlab.desy.de/christopher.passow/flash-daq-hdf||shape="rect"]]17 -{{/ info}}8 +{{view-file att--filename="tmp.mp4" height="250"/}} 9 +{{/expand}} 18 18 19 19 \\ 20 20 21 -[[~[~[image:attach:image2023-9-29_11-1-37.png~]~]>>url:https://hasfcpkg.desy.de/fab/fab.html||shape="rect"]] 22 - 23 23 \\ 24 24 25 -{{expand title="older ideas ..."}} 26 -(% class="Object" %)(object oriented) [[https:~~/~~/gitlab.desy.de/christopher.passow/fdh-builder>>url:https://gitlab.desy.de/christopher.passow/fdh-builder.git||shape="rect"]] 27 - 28 28 ---- 29 29 30 30 === TODO === ... ... @@ -42,18 +42,6 @@ 42 42 GPFS 43 43 {{/task}} 44 44 45 -{{task reference="/Tasks/Task_40" status="InProgress"}} 46 -Access rights 47 -{{/task}} 48 - 49 -{{task reference="/Tasks/Task_41" status="InProgress"}} 50 -Gamma Portal 51 -{{/task}} 52 - 53 -{{task reference="/Tasks/Task_42" status="InProgress"}} 54 -Maxwell 55 -{{/task}} 56 - 57 57 {{task reference="/Tasks/Task_20" status="InProgress"}} 58 58 JupyterHub 59 59 {{/task}} ... ... @@ -234,6 +234,3 @@ 234 234 {{/code}} 235 235 236 236 \\ 237 - 238 -\\ 239 -{{/expand}}