Wiki source code of ComputingResourcesUserGuide

Version 6.1 by sndueste on 2020/02/20 17:13
Show last authors
1 = Brief User Guide to Computing Resources at FLASH =
2
3 \\
4
5 == Introduction ==
6
7 As explained in the [[doc:FLASH.User overview]] page the data recorded at FLASH is stored in an internal DAQ format (.raw) which is converted with a few minutes delay to easily accessible HDF5 ([[doc:FLASHUSER.Data Acquisition and controls.Data Access at FLASH (DAQ, gpfs,\.\.\.).Offline data analysis (DAQ).The FLASH HDF5 structure.WebHome]]) files which are the basis for data analysis. These  files are stored on the [[ASAP3 File System>>url:https://confluence.desy.de/display/ASAP3/ASAP3++Data+Storage+for+PETRA+III||rel="nofollow" shape="rect"]] which is accessible from DESYs  [[Maxwell Cluster>>url:https://confluence.desy.de/display/IS/Maxwell+for+Photon+Science||rel="nofollow" shape="rect"]] which is recommended to be used for the analysis by users. A library provided by FLASH ( [[BeamtimeDaqAccess>>url:https://stash.desy.de/projects/CS/repos/pah||rel="nofollow" shape="rect" class="external-link"]] ) allows efficient access to the recorded data in the HSD5 files. In addition the HDF5 files are accessible from the beamline computers and via a web interface:  [[Gamma Portal~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://gamma-portal.desy.de||shape="rect"]]
8
9 \\
10
11 == Access to the Maxwell cluster ==
12
13
14 The [[Maxwell Cluster>>url:https://confluence.desy.de/display/IS/Photon+Science+on+Maxwell||rel="nofollow" shape="rect"]] is a powerful farm of inter-connected PC nodes running Scientific GNU/Linux. **To access the cluster you need a DESY AFS computing account or a so called scientific account (PSX).**
15
16 \\
17
18 * If you have a default DESY AFS account login to **[[max-fsc.desy.de>>url:http://max-fsc.desy.de||rel="nofollow" shape="rect" class="external-link"]]**{{code language="none"}}{{/code}} using your personal account. (From outside of DESY network tunnel through **[[bastion.desy.de>>url:http://bastion.desy.de||rel="nofollow" shape="rect" class="external-link"]]**{{code language="none"}}{{/code}} or use the [[remote login(% class="confluence-embedded-file-wrapper confluence-embedded-manual-size" %)~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://confluence.desy.de/display/IS/Remote+Login||rel="nofollow" shape="rect"]](%%) to **[[max-display.desy.de>>url:http://max-display.desy.de||rel="nofollow" shape="rect" class="external-link"]]**{{code language="none"}}{{/code}}.
19 * Scientific account users instead go to **[[desy-ps-cpu.desy.de>>url:http://desy-ps-cpu.desy.de||rel="nofollow" shape="rect" class="external-link"]]**{{code language="none"}}{{/code}}. To connect to the Maxwell cluster from outside the DESY network ~-~- eduroam or the DESY guest network are considered to be outside ~-~- then you can SSH tunnel your connection through **[[desy-ps-ext.desy.de>>url:http://desy-ps-ext.desy.de||rel="nofollow" shape="rect" class="external-link"]]**{{code language="none"}}{{/code}} or more conveniently directly use the [[remote login(% class="confluence-embedded-file-wrapper confluence-embedded-manual-size" %)~[~[image:url:http://hasfweb.desy.de/pub/TWiki/TWikiDocGraphics/external-link.gif~|~|width="13" height="12"~]~]>>url:https://confluence.desy.de/display/IS/Remote+Login||rel="nofollow" shape="rect"]](%%) to **[[max-display.desy.de>>url:https://max-display.desy.de:3443/||rel="nofollow" shape="rect" class="external-link"]]**{{code language="none"}}{{/code}}.
20
21 **Note**: Please, always do use your personal account to work on the Maxwell cluster or any central DESY computing resources. Don't use the functional accounts like vuvfuser or bl1user. Using functional accounts on shared resources causes many difficult to predict problems, even if it might appear to work for you in the beginning. Also, **never** try to login to **bastion**{{code language="none"}}{{/code}}, **desy-ps-ext**{{code language="none"}}{{/code}}, or **max-display**{{code language="none"}}{{/code}} using one of the functional accounts.
22
23 The rest of this guide assumes you can login to the suggested Maxwell cluster node and are able to successfully run the command **xclock**{{code language="none"}}{{/code}} to get a clock face displayed on your client computer.
24
25 \\
26
27 \\
28
29
30 \\