Skip to Content

Changes for page 05. Data processing

Last modified by tabermah on 2024-12-11 11:17
From version 31.1
edited by tabermah
on 2024-09-23 16:09
Change comment: There is no comment for this version
To version 30.1
edited by tabermah
on 2024-09-19 16:41
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -81,12 +81,12 @@
81 81  The processing folders contain two folders, 'xdsapp' and 'manual'. 'Manual' contains a template for manual processing having all the correct parameters. However, to shorten the processing time and make use of the computational structure, reprocessing your data on the maxwell nodes should be done by using a script to queue the jobs in slurm:
82 82  
83 83  * a template scripts can be found at /asap3/petra3/gpfs/common/p11/processing_scripts/
84 -** (% style="color: rgb(0,0,0);text-decoration: none;" %)xds_users.sh For (% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)external (% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0); color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)a(% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0); color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0); color: rgb(255, 0, 0)" %)cademic (% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)users
85 -** xds_industry.sh (% style="color: rgb(0,0,0);" %)For (% style="color: rgb(0, 0, 0); color: rgb(255, 0, 0)" %)industry users
86 -** xds_inhouse.sh For (% style="color: rgb(255,0,0);" %)in-house users
84 +** (% style="color: rgb(0,0,0);text-decoration: none;" %)xds_Acad_ext_users.sh For (% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)external (% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0); color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)a(% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0); color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0); color: rgb(255, 0, 0)" %)cademic (% style="color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)users
85 +** xds_Ind_users.sh (% style="color: rgb(0,0,0);" %)For (% style="color: rgb(0, 0, 0); color: rgb(255, 0, 0)" %)industry users
86 +** xds_inhouse_users.sh For (% style="color: rgb(255,0,0);" %)in-house users
87 87  * (% style="color: rgb(0,0,0);" %)differences on the scripts are on the partition used for the processing (i.e. //pscpu// should be used for internal users of Photon Science, //psxcpu// for external academic users and //com// for industrial users) and the used xds version
88 88  * (% style="color: rgb(0,0,0);" %)copy the script to the folder where you run the processing
89 -* (% style="color: rgb(0,0,0);" %)launch the script by typing sbatch xds(% style="color: rgb(0, 0, 0); color: rgb(255, 0, 0)" %)_(% style="color: rgb(0, 0, 0); color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)name_of_the_script(% style="color: rgb(0, 0, 0); color: rgb(0, 0, 0); text-decoration: none" %).sh (e.g., for academic external users //sbatch xds_users.sh// and for industrial users //sbatch xds_industry.sh//)
89 +* (% style="color: rgb(0,0,0);" %)launch the script by typing sbatch xds(% style="color: rgb(0, 0, 0); color: rgb(255, 0, 0)" %)_(% style="color: rgb(0, 0, 0); color: rgb(0, 0, 0); text-decoration: none; color: rgb(255, 0, 0)" %)name_of_the_script(% style="color: rgb(0, 0, 0); color: rgb(0, 0, 0); text-decoration: none" %).sh (e.g., for academic external users //sbatch xds_Acad_ext_users.sh// and for industrial users //sbatch xds_Ind_users.sh//)
90 90  * (% style="color: rgb(0,0,0);" %)the script will find a free node for your job to run fast
91 91  * (% style="color: rgb(0,0,0);" %)the xds-log you get in a file xds-job-~#~##.out.
92 92  
Confluence.Code.ConfluencePageClass[0]
Id
... ... @@ -1,1 +1,1 @@
1 -379128830
1 +379128829
URL
... ... @@ -1,1 +1,1 @@
1 -https://confluence.desy.de/spaces/11/pages/379128830/11. Data processing
1 +https://confluence.desy.de/spaces/11/pages/379128829/11. Data processing