Skip to Content

Changes for page 05. Data processing

Last modified by tabermah on 2024-12-11 11:17
From version 18.1
edited by hakanj
on 2021-04-12 20:53
Change comment: There is no comment for this version
To version 20.1
edited by hakanj
on 2022-04-08 11:40
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -10,7 +10,7 @@
10 10  
11 11  Please do not use the control computers of the beamline (haspp11user01-04) nor the haspp11eval01 for data processing (latter is now fully dedicated to autoprocessing.
12 12  
13 -Use Maxwell-cluster for data processing as described in the next chapter; on-site, you can directly ssh to username@desy-ps-cpu or use Max-display by connecting to [[https:~~/~~/max-display.desy.de:3443>>url:https://max-display.desy.de:3443||shape="rect"]] via web browser. Access to Maxwell requires a Scientific Account.
13 +Use Maxwell-cluster for data processing as described in the next chapter; on-site, you can directly ssh to username@desy-ps-cpu. Access to Maxwell requires a Scientific Account.
14 14  
15 15  \\
16 16  
... ... @@ -19,9 +19,13 @@
19 19  Manual data processing after the beamtime or during a remote session is only available for registered [[DESY Scientific Accounts>>doc:FSEC.Science Accounts.WebHome||shape="rect"]].
20 20  
21 21  //Accessing data from outside the DESY network~://
22 -In a terminal window:
22 +
23 +Accessing the Maxwell cluster is easiest with Max-display:  connect to [[https:~~/~~/max-display.desy.de:3443>>url:https://max-display.desy.de:3443||shape="rect"]] via web browser with the credentials of your scientific account.
24 +
25 +Accesss via terminal window:
23 23  ssh (% class="Object" %)[[username@desy-ps-ext.desy.de>>mailto:username@desy-ps-ext.desy.de||shape="rect"]](%%)
24 24  ssh username@desy-ps-cpu
28 +
25 25  Give your password when prompted
26 26  Navigate to data by:
27 27  cd /asap3/petra3/gpfs/p11/2020/data/beamtimeID
... ... @@ -34,8 +34,14 @@
34 34  (% style="color: rgb(51,51,51);text-decoration: none;" %)Copy the script to the folder where you run the processing and launch by (%%)
35 35  (% style="color: rgb(51,51,51);text-decoration: none;" %)sbatch xds.sh(%%)
36 36  (% style="color: rgb(51,51,51);text-decoration: none;" %)It will find a free node for your job and run faster than just typing xds_par(%%)
37 -(% style="color: rgb(51,51,51);text-decoration: none;" %)The xds-log you get in a file xds-job-~#~##.out(%%)
38 -\\//List of software you can use is at~://
41 +(% style="color: rgb(51,51,51);text-decoration: none;" %)The xds-log you get in a file xds-job-~#~##.out
42 +
43 +(% style="color: rgb(51,51,51);text-decoration: none;" %)nxds can be used for processing Serial Crystallography data in a similar way than xds. As the computing time is long, nxds should should be used via a script to queue the jobs in slurm. The template script (nxds.sh) as well as an example of input file (nXDS.INP) can be found in /asap3/gpfs/common/p11/.
44 +
45 +(% style="color: rgb(51,51,51);text-decoration: none;" %)Copy the script and the nXDS.INP to the folder where you run the processing. The nXDS.INP file needs some editing to fit your data path and data collection parameters (wavelength, detector distance, oscillation...). The processing is launch by
46 +sbatch nxds.sh
47 +
48 +//List of software you can use is at~://
39 39  (% class="Object" %)[[https:~~/~~/confluence.desy.de/display/IS/Photon+Science>>doc:IS.Photon Science.WebHome||shape="rect"]](%%)
40 40  \\//You can store analysis results in scratch_cc (temporary/testing results) or processed (final results).//
41 41  \\//To use crystallographic programs~://
... ... @@ -43,3 +43,7 @@
43 43  module load xray     # sets the environment for xds and helper GUIs such as XDSAPP
44 44  module load ccp4/6.4
45 45  module load phenix 
56 +
57 +\\
58 +
59 +\\
Confluence.Code.ConfluencePageClass[0]
Id
... ... @@ -1,1 +1,1 @@
1 -235039402
1 +256500300
URL
... ... @@ -1,1 +1,1 @@
1 -https://confluence.desy.de/spaces/11/pages/235039402/11. Data processing
1 +https://confluence.desy.de/spaces/11/pages/256500300/11. Data processing