Skip to Content

Changes for page 05. Data processing

Last modified by tabermah on 2024-12-11 11:17
From version 9.1
edited by janmeyer
on 2020-11-11 12:52
Change comment: There is no comment for this version
To version 14.1
edited by hakanj
on 2020-12-18 14:57
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -10. Data processing
1 +11. Data processing
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.janmeyer
1 +XWiki.hakanj
Content
... ... @@ -2,14 +2,15 @@
2 2  
3 3  **10.1. Automatic data processing**
4 4  
5 -Results of the automatic data processing are only available during the beamtime. To see the data presenter, open a Browser (Open Terminal and type:(% style="color: rgb(51,153,102);" %) firefox(%%)) and type(% style="color: rgb(51,153,102);" %) /gpfs/current/processed/index.html.
5 +Unless you un-check the option for the specific acquisition run, autoprocessing will be executed. For standard rotational data autoprocessing is via XDSAPP (Sparta et al. (2016) //J. Apple. Cryst.// **49**, 1085-1092) for strategy calculation we use Mosflm (Leslie //Acta D//**62** (2006) 48-57) and Spotfinder ((% style="color: rgb(0,0,0);text-decoration: none;" %)Zhang et al. (2006). (% style="text-decoration: none;text-align: left;" %)//J. Appl. Cryst.//(% style="color: rgb(0,0,0);text-decoration: none;" %) (% style="text-decoration: none;text-align: left;" %)**39**(% style="color: rgb(0,0,0);text-decoration: none;" %), 112–119)(%%) for producing the heatmap for the grid scans. The results are compiled into HTML-files to give you a convenient way of checking them. The output files are in the processed folders of the corresponding datasets.  A self refreshing index of all results is created in the beamtimes processed folder. During the beamtime you can open it from file::~/~//gpfs/current/processed/index.html in a browser. The HTML-file is also contained in your data backup.
6 6  
7 +\\
7 7  
8 -**10.3. Manual data processing during your beamtime**
9 +**10.3. Manual data processing onsite**
9 9  
10 -Open a terminal (see session 3.2) and type ssh haspp11eval01. You need to open one terminal and ssh to haspp11eval01 for every program you want to use.
11 +Open a terminal (see session 3.2) and type ssh haspp11eval01. Please do not use the control computers of the beamline (haspp11user01-04) for data processing.
11 11  
12 -To use crystallographic programs:
13 +Here you can launch crystallographic programs directly //e.g.//:
13 13  
14 14  * for XDSAPP type in the terminal (% style="color: rgb(0,128,0);" %)xdsapp
15 15  * for imosflm type in the terminal (% style="color: rgb(0,128,0);" %)imosflm
... ... @@ -16,18 +16,21 @@
16 16  * for CCP4 type in the terminal (% style="color: rgb(0,128,0);" %)ccp4i
17 17  * for phenix type in the terminal (% style="color: rgb(0,128,0);" %)phenix
18 18  
19 -**10.4. Manual data processing after your beamtime**
20 +\\
20 20  
21 -Manual data processing after the beamtime is only available for registered [[DESY Science Accounts>>doc:FSEC.Science Accounts.WebHome||shape="rect"]].
22 +**10.4. Manual data processing after your beamtime or during remote session**
22 22  
23 -//Accessing data//
24 +Manual data processing after the beamtime or during a remote session is only available for registered [[DESY Science Accounts>>doc:FSEC.Science Accounts.WebHome||shape="rect"]].
25 +
26 +//Accessing data from outside the DESY network~://
24 24  In a terminal window:
25 25  ssh (% class="Object" %)[[username@desy-ps-ext.desy.de>>mailto:username@desy-ps-ext.desy.de||shape="rect"]](%%)
26 26  ssh username@desy-ps-cpu
27 27  Give your password when prompted
28 28  Navigate to data by:
29 -cd /asap3/petra3/gpfs/p11/2020/data/beamtimeID
30 -(you can only access the data your Door account was related to during the data collections. if you did not participate to the beamtime but are part of the group and would like to access the data, please contact (whom? I'll try to figure this out)
32 +cd /asap3/petra3/gpfs/p11/2020/data/beamtimeID
33 +
34 +Data is accessible to users who were registered participants to the experiment in Door prior to the beamtime ID being opened at the beamline. If you cannot access the data, please contact your LC or the beamline manager.
31 31  \\//List of software you can use is at~://
32 32  (% class="Object" %)[[https:~~/~~/confluence.desy.de/display/IS/Photon+Science>>doc:IS.Photon Science.WebHome||shape="rect"]](%%)
33 33  \\//You can store analysis results in scratch_cc (temporary/testing results) or processed (final results).//
Confluence.Code.ConfluencePageClass[0]
Id
... ... @@ -1,1 +1,1 @@
1 -183172152
1 +188798288
Title
... ... @@ -1,1 +1,1 @@
1 -10. Data processing
1 +11. Data processing
URL
... ... @@ -1,1 +1,1 @@
1 -https://confluence.desy.de/spaces/11/pages/183172152/10. Data processing
1 +https://confluence.desy.de/spaces/11/pages/188798288/11. Data processing