Wiki source code of SciCat

Version 13.13 by rkwee on 2026-02-16 11:18

Hide last authors
rkwee 13.2 1 ## General information about SciCat at DESY
barthn 2.1 2
rkwee 3.1 3 SciCat stands for “Science Catalogue” and is generally used as a metadata catalogue for finding back data, addressing thereby the needs of a growing photon and neutron science community. It is used at many large European facilities before it came to DESY in January 2022, like PSI, ESS, MaxIV.
barthn 2.1 4
rkwee 5.1 5 The challenge in photon and neutron science is to find a standard way of naming characteristics for a huge variety of experiments at beamlines, interconnecting several fields like chemistry, material science, biology, medicine, etc – covering many aspects that influences daily life. Apart from the "normal" physics research there are various other types of research depending on the purpose one can perform at DESY: inhouse, commissioning, industries. In additon, there are differences from PetraIII and FLASH within photon science. All this is reflected in the different treatment of the data taken.
rkwee 4.1 6
rkwee 13.4 7 One of SciCats strengths is that technically one can impose your own schema, the fields to describe your use case. Many efforts were made at the European scope to use standardised vocabulary such that scientific metadata can be gathered and made findable, accessible and interoperable at first and ultimately reusable, eg. in NFDI and EOSC framed projects. DESY's SciCat system follows those standards.
rkwee 4.1 8
rkwee 13.3 9 To gain experience so-called _demonstrator beamlines_ where chosen, in 2021 when SciCat was chosen at DESY to be tested. These were: P08 and FLASH. In the next two following years, serveral other have been added, see [SciCat Instances](https://xwiki.desy.de/xwiki/bin/view/IT/SciCat/CICD%20Setup/). These helped to identify missing features and adopt SciCat to DESY needs.
rkwee 12.2 10
rkwee 13.8 11 ### Goals for SciCat at DESY
12
13 Goal number one is to provide a useful catalogue to the user at DESY. Useful means - among others -
14
rkwee 13.9 15 * Introduce standardised way of defining meta data, FS-EC (under Linus Pithan).
16 * Use SciCat to help book keeping of what was measured which also helps planning new research studies.
rkwee 13.8 17 * Use SciCat to issue DOIs: Together with the DESY library develop detailed workflow to help the user make data publication.
rkwee 13.12 18 * Use SciCat to provide access to experimental data that comply with DESY photon science data Policy and can be made available through DESY resources.
rkwee 13.8 19
rkwee 13.10 20 ### Milestone achieved by January 2026:
rkwee 5.1 21
rkwee 13.10 22 Set up of the system to mint DOIs.
23
rkwee 12.4 24 ## Step by step guide for the Photon Science DOI minting Service
25
rkwee 13.11 26 The system is set up such that an internal and public, outward facing SciCat is provided. Into the internal, several PETRA beamlines ingest directly their metadata during beamtime that are P08, P05, P65. The URL is
rkwee 13.8 27
rkwee 13.11 28 [scicat.desy.de](https://scicat.desy.de), it has already more then 100,000 dataset entries where one of them has 160,000 associated datafiles (Feb 2026). It is MFA protected but single sign on is available through keykloak .
rkwee 13.8 29
30 It is connected to the external catalogue, fsdata.desy.de, on which DOIs can be minted for selected datasets from the internal catalogue.
31
rkwee 12.4 32 {{success}}
rkwee 13.3 33 A detailed description of how to mint a DOI for your data is described on this [[page|doc:IT.SciCat.Step-by-step DOI minting Guide at DESY.WebHome]].
rkwee 12.4 34 {{/success}}
35
rkwee 13.8 36 ###
rkwee 8.1 37
rkwee 13.4 38 ## Deployment of SciCat at DESY
39
rkwee 13.13 40 This service is deployed on a Kubernetes cluster, managed and configured by gitlab repositories for
rkwee 13.5 41
rkwee 13.13 42 * temp
43
rkwee 13.5 44 ###
45
rkwee 13.4 46 ### Current
47
rkwee 12.4 48 ### Main Links:
rkwee 10.2 49
barthn 2.4 50 * [Official Scicat website](https://scicatproject.github.io)
51 * [Official SciCat project repositories](https://github.com/SciCatProject)
52 * [Official Scicat documentation](https://scicatproject.github.io/documentation/)
53 * [DESY internal repositories](https://gitlab.desy.de/it-infa/metadata)