Skip to Content

Changes for page 05. Data processing

Last modified by tabermah on 2024-12-11 11:17
From version 15.1
edited by hakanj
on 2020-12-18 14:59
Change comment: There is no comment for this version
To version 18.1
edited by hakanj
on 2021-04-12 20:53
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -8,20 +8,15 @@
8 8  
9 9  **11.2. Manual data processing onsite**
10 10  
11 -Open a terminal (see session 3.2) and type ssh haspp11eval01. Please do not use the control computers of the beamline (haspp11user01-04) for data processing.
11 +Please do not use the control computers of the beamline (haspp11user01-04) nor the haspp11eval01 for data processing (latter is now fully dedicated to autoprocessing.
12 12  
13 -Here you can launch crystallographic programs directly //e.g.//:
13 +Use Maxwell-cluster for data processing as described in the next chapter; on-site, you can directly ssh to username@desy-ps-cpu or use Max-display by connecting to [[https:~~/~~/max-display.desy.de:3443>>url:https://max-display.desy.de:3443||shape="rect"]] via web browser. Access to Maxwell requires a Scientific Account.
14 14  
15 -* for XDSAPP type in the terminal (% style="color: rgb(0,128,0);" %)xdsapp
16 -* for imosflm type in the terminal (% style="color: rgb(0,128,0);" %)imosflm
17 -* for CCP4 type in the terminal (% style="color: rgb(0,128,0);" %)ccp4i
18 -* for phenix type in the terminal (% style="color: rgb(0,128,0);" %)phenix
19 -
20 20  \\
21 21  
22 22  **11.3. Manual data processing after your beamtime or during remote session**
23 23  
24 -Manual data processing after the beamtime or during a remote session is only available for registered [[DESY Science Accounts>>doc:FSEC.Science Accounts.WebHome||shape="rect"]].
19 +Manual data processing after the beamtime or during a remote session is only available for registered [[DESY Scientific Accounts>>doc:FSEC.Science Accounts.WebHome||shape="rect"]].
25 25  
26 26  //Accessing data from outside the DESY network~://
27 27  In a terminal window:
... ... @@ -32,6 +32,14 @@
32 32  cd /asap3/petra3/gpfs/p11/2020/data/beamtimeID
33 33  
34 34  Data is accessible to users who were registered participants to the experiment in Door prior to the beamtime ID being opened at the beamline. If you cannot access the data, please contact your LC or the beamline manager.
30 +
31 +(% style="color: rgb(51,51,51);text-decoration: none;" %)Our processing folders now contain two folders, 'full' and 'manual'. 'Manual' contains a template that has all the correct parameters and processing will run just by typing xds_par there. However, to shorten the processing time and make use of the computational structure, you should use a script to queue the jobs in slurm. A template script (xds.sh) can be found at /asap3/petra3/gpfs/common/p11/xds.sh
32 +
33 +The partition in the script is defined psx for external users (ps should be used for internal users of Photon Science).
34 +(% style="color: rgb(51,51,51);text-decoration: none;" %)Copy the script to the folder where you run the processing and launch by (%%)
35 +(% style="color: rgb(51,51,51);text-decoration: none;" %)sbatch xds.sh(%%)
36 +(% style="color: rgb(51,51,51);text-decoration: none;" %)It will find a free node for your job and run faster than just typing xds_par(%%)
37 +(% style="color: rgb(51,51,51);text-decoration: none;" %)The xds-log you get in a file xds-job-~#~##.out(%%)
35 35  \\//List of software you can use is at~://
36 36  (% class="Object" %)[[https:~~/~~/confluence.desy.de/display/IS/Photon+Science>>doc:IS.Photon Science.WebHome||shape="rect"]](%%)
37 37  \\//You can store analysis results in scratch_cc (temporary/testing results) or processed (final results).//
Confluence.Code.ConfluencePageClass[0]
Id
... ... @@ -1,1 +1,1 @@
1 -200517675
1 +235039402
URL
... ... @@ -1,1 +1,1 @@
1 -https://confluence.desy.de/spaces/11/pages/200517675/11. Data processing
1 +https://confluence.desy.de/spaces/11/pages/235039402/11. Data processing