Skip to Content

Changes for page 06. Data Backup

Last modified by tabermah on 2024-12-10 14:54
From version 13.1
edited by hakanj
on 2022-07-06 13:10
Change comment: There is no comment for this version
To version 5.1
edited by janmeyer
on 2020-11-11 13:44
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -12. Data Backup
1 +11. Data Back up
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.hakanj
1 +XWiki.janmeyer
Content
... ... @@ -1,30 +1,23 @@
1 -**12.1. Backup to USB-drive during beamtime**
1 +**10.1. Backup to USB-drive during beamtime**
2 2  
3 -If you bring a USB-drive, you may sync the data onto it during the beamtime. We provide a dedicated PC for this purpose, which is running debian. It is advisable to bring a drive which is known to work fast on Linux systems, as some chipsets might be too slow to keep up with the speed at which you take data. Please also note, that ExFAT is currently not supported. FAT32, NTFS, ext4 should all work fine.
3 +If you bring a USB-drive, you may sync the data onto it during the beamtime. We provide a dedicated PC for this purpose, which is running debian. It is advisable to bring a drive which is known work fast on Linux systems, as some chipsets might be too slow to keep up with the speed at which you take data. Please also note, that ExFAT is currently not supported. FAT32, NTFS, ext4 should all work fine, for other file-systems we can not give any guarantee.
4 4  
5 -There is a script prepared, which will continuously sync the data onto your hard-drive.  Source and destination path have to be adapted beforehand. Your local contact will help you with this. I(% style="color: rgb(23,43,77);" %)nstructions(%%) can also be found (% style="color: rgb(23,43,77);" %)in the hutch.
5 +There is a script prepared, which will continuously sync the data onto your hard-drive.  Source and destination path have to be adapted beforehand. Usually, your local contact will help you with this. I(% style="color: rgb(23,43,77);" %)nstructions(%%) can also be found (% style="color: rgb(23,43,77);" %)in the hutch, next to the printer.
6 6  
7 -There are two possibilities as where to copy your data from:
7 +There are to possibilities as were to copy your data from:
8 8  
9 -* The core file system /asap3/petra3/gpfs/p11/<YEAR>/data/<BEAMTIME>. This is the way we recommend as it has several advantages. You will need to log in with a (% style="color: rgb(23,43,77);" %) (%%)[[DESY Science Account>>doc:FSEC.Science Accounts.WebHome||style="text-decoration: none;" rel="nofollow" shape="rect"]] which was added to the beamtimes authorized list by the PI(% style="color: rgb(23,43,77);" %).
10 -* (% style="color: rgb(23,43,77);" %)The beamline file system /gpfs/current/. You may log in as p11user to do this. Any data resulting from manual processing done on the Maxwell resource will not be visible here and thus not be contained in your backup. As soon as the next user group starts and your beamtime is closed, you will have to stop copying.
9 +* The core file system /asap3/petra3/gpfs/p11/<YEAR>/data/<BEAMTIME>. This is the way we recommend as it has several advantages. You will need to log in with a (% style="color: rgb(23,43,77);" %) (%%)[[DESY Science Account>>doc:FSEC.Science Accounts.WebHome||style="text-decoration: none;" rel="nofollow" shape="rect"]] which was added to the beamlines authorized list by the PI(% style="color: rgb(23,43,77);" %).
10 +* (% style="color: rgb(23,43,77);" %)The beamline file system /gpfs/current/. You may log in as p11user to do this. Any data resulting from manual processing performed on the Maxwell resource will not be visible here and thus not be contained in your backup. As soon as the next user group starts and your beamtime is closed, you will have to stop copying.
11 11  
12 12  \\
13 13  
14 -**12.2. Download your data during or after the beamtime via FTP**
14 +**10.2. Download your data during or after the beamtime via NFS**
15 15  
16 - Data are available for download via FTP protocol through the [[Gamma Portal>>url:https://gamma-portal.desy.de/||shape="rect"]] as it is described in [[here>>doc:ASAP3.The Gamma Portal.WebHome||shape="rect"]].
16 + Data are available for download via ftp protocol on the [[Gamma portal>>url:https://gamma-portal.desy.de/||shape="rect"]] as it is described in [[here>>doc:ASAP3.The Gamma Portal.WebHome||shape="rect"]]. You need a DESY-Door-Account, which has to be added to the  authorized list by the PI, to make use of this.
17 17  
18 -**Important recently:**
19 -Since (% class="Object" %)Monday(%%), 04.07.2022, around 2 p.m., the Gamma portal at (% class="Object" %)[[https:~~/~~/gamma-portal.desy.de>>url:https://gamma-portal.desy.de||shape="rect"]](%%) cannot be accessed.
20 -Until the problem is solved, the portal can be reached via the following alternative URL:
21 -(% class="Object" %)[[https:~~/~~/ias.desy.de/pls/apex/f?p=260:1>>url:https://ias.desy.de/pls/apex/f?p=260:1||shape="rect"]](%%)
22 -Colleagues are working to solve the problem.
23 -Trouble cause by: Faulty communication with the load balancer F5
24 -
25 25  \\
26 26  
27 -**12.3. Download your data during or after the beamtime using Globus**
20 +**10.3. Download your data during or after the beamtime using Globus**
28 28  
29 29  [[https:~~/~~/www.globus.org/data-transfer>>url:https://www.globus.org/data-transfer||shape="rect"]]
30 30  
Confluence.Code.ConfluencePageClass[0]
Id
... ... @@ -1,1 +1,1 @@
1 -272734563
1 +183172010
Title
... ... @@ -1,1 +1,1 @@
1 -12. Data Backup
1 +11. Data Back up
URL
... ... @@ -1,1 +1,1 @@
1 -https://confluence.desy.de/spaces/11/pages/272734563/12. Data Backup
1 +https://confluence.desy.de/spaces/11/pages/183172010/11. Data Back up