Changes for page ComputingResourcesUserGuide
Last modified by loktevda on 2025-12-05 11:44
From version 18.2
edited by sndueste
on 2025-02-05 14:57
on 2025-02-05 14:57
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Parent
-
... ... @@ -1,0 +1,1 @@ 1 +FS-FLASH USER tmp.Data Acquisition and controls.WebHome - Content
-
... ... @@ -1,9 +1,12 @@ 1 1 = Brief Guide to Computing Resources at FLASH = 2 2 3 3 4 +(% style="color: rgb(231, 76, 60); font-size: 24px" %)**TO BE UPDATED** 5 + 6 + 4 4 == Introduction == 5 5 6 -As explained in the [[User overview>>doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.WebHome]] page the data recorded at FLASH is stored in an internal DAQ format (.raw) which is converted with a few minutes delay to easily accessible HDF5 ([[doc:FLASHUSER.Data Acquisition and controls.DAQ and controls overview.Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]]) files which are the basis for data analysis. These files are stored on the [[ASAP3 File System>>https://docs.desy.de/asap3/||rel="nofollow" shape="rect"]] which is accessible from DESYs [[Maxwell Cluster>>https://docs.desy.de/maxwell/||shape="rect"]] which is recommended to be used for the analysis by users. H5py and Pandas allow efficient access to the recorded data in the HDF5 files. In addition the HDF5 files are accessible from the beamline computers and via a web interface: [[Gamma Portal>>url:https://gamma-portal.desy.de||shape="rect"]] 9 +As explained in the [[User overview>>doc:FS-FLASH USER tmp.Data Acquisition and controls 1.DAQ and controls overview.WebHome]] page the data recorded at FLASH is stored in an internal DAQ format (.raw) which is converted with a few minutes delay to easily accessible HDF5 ([[doc:FS-FLASH USER tmp.Data Acquisition and controls 1.DAQ and controls overview.Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]]) files which are the basis for data analysis. These files are stored on the [[ASAP3 File System>>https://docs.desy.de/asap3/||rel="nofollow" shape="rect"]] which is accessible from DESYs [[Maxwell Cluster>>https://docs.desy.de/maxwell/||shape="rect"]] which is recommended to be used for the analysis by users. H5py and Pandas allow efficient access to the recorded data in the HDF5 files. In addition the HDF5 files are accessible from the beamline computers and via a web interface: [[Gamma Portal>>url:https://gamma-portal.desy.de||shape="rect"]] 7 7 8 8 9 9 == Access to the Maxwell cluster == ... ... @@ -16,7 +16,7 @@ 16 16 To get a PSX account please talk to your local contact well before the beamtime. 17 17 {{/info}} 18 18 19 -* To connect to the Maxwell cluster as PhotonScience user (or staff) please have a look to the [[Photon Science Resources - Maxwell >> url:https://confluence.desy.de/display/MXW/Photon+Science+Resources||shape="rect"]] pages.22 +* To connect to the Maxwell cluster as PhotonScience user (or staff) please have a look to the [[Photon Science Resources - Maxwell >>https://docs.desy.de/maxwell/documentation/photon_science_resources/||shape="rect"]] pages. 20 20 * From outside the DESY network ~-~- eduroam or the DESY guest network are considered to be outside ~-~- then you can SSH tunnel your connection through **[[max-display.desy.de>>url:https://confluence.desy.de/display/MXW/Interactive+Login||shape="rect"]]**{{code language="none"}}{{/code}}. 21 21 22 22 {{info title="login with functional accounts"}} ... ... @@ -25,8 +25,8 @@ 25 25 26 26 == Maxwell cluster == 27 27 28 -The extensive documentation can be found at [[Maxwell Cluster>> url:https://confluence.desy.de/display/MXW/Maxwell+Cluster||shape="rect"]]31 +The extensive documentation can be found at [[Maxwell Cluster>>https://docs.desy.de/maxwell/||shape="rect"]] 29 29 30 -In particular we want to mention the option [[JupyterHub2 on Maxwell>>https://docs.desy.de/maxwell/services/jupyterhub/]] , available [[Software>>doc:IS.Software]], formore advanced computing demands [[Running Jobs on Maxwell.>>https://docs.desy.de/maxwell/services/]]33 +In particular we want to mention the option [[JupyterHub2 on Maxwell>>https://docs.desy.de/maxwell/services/jupyterhub/]] , for more advanced computing demands [[Running Jobs on Maxwell.>>https://docs.desy.de/maxwell/services/]] 31 31 32 32