Skip to Content
Last modified by rkwee on 2026-02-16 11:45
From version 12.3
edited by rkwee
on 2026-02-16 10:35
Change comment: There is no comment for this version
To version 13.8
edited by rkwee
on 2026-02-16 11:10
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,55 +1,52 @@
1 -## General information about SciCat
1 +## General information about SciCat at DESY
2 2  
3 3  SciCat stands for “Science Catalogue” and is generally used as a metadata catalogue for finding back data, addressing thereby the needs of a growing photon and neutron science community. It is used at many large European facilities before it came to DESY in January 2022, like PSI, ESS, MaxIV.
4 4  
5 5  The challenge in photon and neutron science is to find a standard way of naming characteristics for a huge variety of experiments at beamlines, interconnecting several fields like chemistry, material science, biology, medicine, etc – covering many aspects that influences daily life. Apart from the "normal" physics research there are various other types of research depending on the purpose one can perform at DESY: inhouse, commissioning, industries. In additon, there are differences from PetraIII and FLASH within photon science. All this is reflected in the different treatment of the data taken.
6 6  
7 -One of SciCats strengths is that technically one can impose your own schema, the fields to describe your use case. These pages describe the current state of SciCat. The ultimate goal is to have a production system of SciCat that serves all beamlines.
7 +One of SciCats strengths is that technically one can impose your own schema, the fields to describe your use case. Many efforts were made at the European scope to use standardised vocabulary such that scientific metadata can be gathered and made findable, accessible and interoperable at first and ultimately reusable, eg. in NFDI and EOSC framed projects. DESY's SciCat system follows those standards.
8 8  
9 -To gain experience so-called _demonstrator beamlines_ where chosen, where a test instance of SciCat has been setup. These are: P08 and FLASH. In addition serveral other have been added, see [SciCat Instances](https://xwiki.desy.de/xwiki/bin/view/IT/SciCat/CICD%20Setup/). These help to identify missing features and adopt SciCat to DESY needs.
9 +To gain experience so-called _demonstrator beamlines_ where chosen, in 2021 when SciCat was chosen at DESY to be tested. These were: P08 and FLASH. In the next two following years, serveral other have been added, see [SciCat Instances](https://xwiki.desy.de/xwiki/bin/view/IT/SciCat/CICD%20Setup/). These helped to identify missing features and adopt SciCat to DESY needs.
10 10  
11 -### Current state of SciCat at DESY
12 -
13 -Beamline ingestion has been streamlined such that there is one single catalogue for all DESY beamlines.
14 -
15 15  ### Goals for SciCat at DESY
16 16  
17 17  Goal number one is to provide a useful catalogue to the user at DESY. Useful means - among others -
18 18  
19 -* introduce standardised way of defining meta data, FS-EC (under Linus Pithan)
20 -* use SciCat to issue DOIs: in agreement with L start setting up a workflow (involved IT-RIC Tim W)
21 -* provide technical support for instances (IT-InFa)
15 +* Introduce standardised way of defining meta data, FS-EC (under Linus Pithan)
16 +* Use SciCat to help book keeping of what was measured.
17 +* Use SciCat to issue DOIs: Together with the DESY library develop detailed workflow to help the user make data publication.
18 +* Use SciCat to access experimental data that comply with DESY Policy and .
19 +* Provide technical support for instances (IT-InFa)
22 22  
23 -### Step by step guide for the Photon Science DOI minting Service
21 +###
24 24  
23 +###
24 +
25 +## Step by step guide for the Photon Science DOI minting Service
26 +
27 +The system is set up such that we provide an internal and public, outward facing SciCat. Into the internal, several PETRA beamlines ingest directly their metadata during beamtime that are P08, P05, P65. The URL is
28 +
29 +[scicat.desy.de](https://scicat.desy.de), it has already more then 100,000 dataset entries where one of them has 160,000 associated datafiles (Feb 2026). It is MFA protected but single sign on is availble through keykloak.
30 +
31 +It is connected to the external catalogue, fsdata.desy.de, on which DOIs can be minted for selected datasets from the internal catalogue.
32 +
25 25  {{success}}
26 -see this [[page|doc:IT.SciCat.Step-by-step DOI minting Guide at DESY.WebHome]]
34 +A detailed description of how to mint a DOI for your data is described on this [[page|doc:IT.SciCat.Step-by-step DOI minting Guide at DESY.WebHome]].
27 27  {{/success}}
28 28  
29 -Main Links:
37 +###
30 30  
39 +## Deployment of SciCat at DESY
40 +
41 +To provide this service
42 +
43 +###
44 +
45 +### Current
46 +
47 +### Main Links:
48 +
31 31  * [Official Scicat website](https://scicatproject.github.io)
32 32  * [Official SciCat project repositories](https://github.com/SciCatProject)
33 33  * [Official Scicat documentation](https://scicatproject.github.io/documentation/)
34 34  * [DESY internal repositories](https://gitlab.desy.de/it-infa/metadata)
35 -
36 -Structure draft
37 -
38 -* Infos about the repositories
39 - * Frontend
40 - * Backend
41 - * etc.
42 -* CI/CD Setup
43 - * Schedules
44 - * Process
45 - * what, why, when
46 -* Deployment
47 - * Helm
48 - * Workflow
49 - * What is configured where
50 -* Migration
51 - * Workflow
52 -* Kubernetes
53 - * Structure
54 -* Scicat and Keycloak
55 - * Workflow