Validating semantic artefact profiles for Research Object Crates
COMP66090 MSc project 2023/2024
- COMP66090 Handbook entry
- This project has PhD potential
- Skills needed: Logic, Programming
Background
Research Object Crate (RO-Crate) is a community-based specification for sharing complex research data with structured metadata on the Web. It is based on existing Linked Data standards and the schema.org vocabulary favoured by Google, Microsoft Bing and other search engines for Rich Web Results and integration with knowledge graph tecnhologies.
RO-Crate defines a core profile of specific requirements for a JSON-LD file, that gives consistent representations for largely bibliographic metadata for the data, but can also detail provenance and software executions and open-ended extensions using Linked Data. Different research domains and infrastructures expand these requirements to provide more specific profiles, for instance for biodiversity data (species, geolocation), cultural heritage (natural language recordings) or additional computational details (Jupyter notebooks, Docker containers). Interactive tools like Crate-O use such profiles to dynamically build a customized user interface, as well as providing rudimentary validation.
Validation is an important pre-requisite before reliable programmatic consumption of any data, particularly from the Web. As RO-Crate is based on Linked Data standards (RDF and JSON-LD), several mature technologies exist that can be used for a thorough and flexible validation, including JSON Schema, RDF shapes (ShEX, SHACL) and query languages (SPARQL, JQ).
Description
In this project you will refresh background on Linked Data technology in order to investigate the existing RO-Crate Profile Crate formalization (based on W3C Profiles vocabulary). You’ll decide on (and justify) which existing technologies should be combined in order to provide a flexible profile-based validation of existing RO-Crates.
You’ll develop a validator tool/service/library that uses the chosen technologies and retrieves the required schemas based on the profile specified by the RO-Crate or as specified by the user. Typical programming languages could be Python (e.g. to extend existing RO-Crate validator code), but you are free to choose any other language.
You will help improve the Profile Crate formalization for any additional requirements uncovered, and can explore how to represent or visualize validation results for a given profile. As development of validation schemas can require significant Linked Data or JSON Schema knowledge for Profile Crate authors, you may also explore the use of templates or simplified profile requirements to auto-generate initial versions of such schemas.
In this project you will be working with the international RO-Crate community which is led by The University of Manchester together with The University of Queensland, Australia. The community provide exciting use cases from a range of scientific domain beyond Computer Science.
A possible extension of this project is to explore generalizing the Profile Crate mechanism for any semantic artefacts (ontologies, mappings) in collaboration with experts in the European Open Science Cloud project FAIR-IMPACT.
We encourage development of open source software, and will be assisting you in following best practices for research software engineering.