Wiki source code of 10. Data processing
Version 11.1 by hakanj on 2020-11-11 16:28
Show last authors
| author | version | line-number | content |
|---|---|---|---|
| 1 | \\ | ||
| 2 | |||
| 3 | **10.1. Automatic data processing** | ||
| 4 | |||
| 5 | Unless you un-check the option for the specific acquisition run, some basic auto processing will be done for you. For standard rotational data XDSAPP is run, for strategy calculation we use mosflm and spotfinder from the phenix package to process the heat map for the grid scans. The results are compiled into HTML-files to give you a convenient way of checking them. These files live in the processed folders of the corresponding datasets. A self refreshing index of all results is created in the beamtimes processed folder. During the beamtime you can open it from file::~/~//gpfs/current/processed/index.html in a browser. All HTML-files will be contained in your copy of the data. | ||
| 6 | |||
| 7 | \\ | ||
| 8 | |||
| 9 | **10.3. Manual data processing onsite** | ||
| 10 | |||
| 11 | Open a terminal (see session 3.2) and type ssh haspp11eval01. You need to open one terminal and ssh to haspp11eval01 for every program you want to use. | ||
| 12 | |||
| 13 | To use crystallographic programs: | ||
| 14 | |||
| 15 | * for XDSAPP type in the terminal (% style="color: rgb(0,128,0);" %)xdsapp | ||
| 16 | * for imosflm type in the terminal (% style="color: rgb(0,128,0);" %)imosflm | ||
| 17 | * for CCP4 type in the terminal (% style="color: rgb(0,128,0);" %)ccp4i | ||
| 18 | * for phenix type in the terminal (% style="color: rgb(0,128,0);" %)phenix | ||
| 19 | |||
| 20 | **10.4. Manual data processing after your beamtime** | ||
| 21 | |||
| 22 | Manual data processing after the beamtime is only available for registered [[DESY Science Accounts>>doc:FSEC.Science Accounts.WebHome||shape="rect"]]. | ||
| 23 | |||
| 24 | //Accessing data// | ||
| 25 | In a terminal window: | ||
| 26 | ssh (% class="Object" %)[[username@desy-ps-ext.desy.de>>mailto:username@desy-ps-ext.desy.de||shape="rect"]](%%) | ||
| 27 | ssh username@desy-ps-cpu | ||
| 28 | Give your password when prompted | ||
| 29 | Navigate to data by: | ||
| 30 | cd /asap3/petra3/gpfs/p11/2020/data/beamtimeID | ||
| 31 | (you can only access the data your Door account was related to during the data collections. if you did not participate to the beamtime but are part of the group and would like to access the data, please contact (whom? I'll try to figure this out) | ||
| 32 | \\//List of software you can use is at~:// | ||
| 33 | (% class="Object" %)[[https:~~/~~/confluence.desy.de/display/IS/Photon+Science>>doc:IS.Photon Science.WebHome||shape="rect"]](%%) | ||
| 34 | \\//You can store analysis results in scratch_cc (temporary/testing results) or processed (final results).// | ||
| 35 | \\//To use crystallographic programs~:// | ||
| 36 | module avail | ||
| 37 | module load xray # sets the environment for xds and helper GUIs such as XDSAPP | ||
| 38 | module load ccp4/6.4 | ||
| 39 | module load phenix |