Core Components

The conceptual and code-level artefacts of the assessment space: Metrics and Benchmarks at the conceptual level, Tests and Algorithms at the code level.

Tip

This page covers several components. Use the On this page panel on the right to jump straight to a section.

Conceptual Components

The conceptual components take the form of:

• Metrics: features of a digital object that can or should be measured, and why it is useful to measure them. These are instantiated as Tests.

• Benchmarks: overall expectations for the features of a digital object. Benchmarks are aggregations of Metrics, together with an explanation of how important a given metric is relative to other metrics, and how to interpret the pass/fail result of a metric or a group of metrics. These are instantiated as Algorithms.

FAIR Metrics

The metrics for FAIR testing are catalogued in the FAIRassist repository (hosted by FAIRsharing).

DMP Metrics

Open the catalogue of DMP Metrics.

FAIR Benchmarks

The community-authored benchmarks for FAIR assessment are catalogued in the FAIRassist repository (hosted by FAIRsharing).

Code Components

The code components take the form of:

• Tests: Tests are the code-level instantiations of the objectives defined by a Metric.

• Algorithms: Algorithms are the code-level instantiations of the objectives and priorities defined by a Benchmark.

FAIR Tests

The tests below are maintained as live endpoints by the OSTrails project together with private partners who are committed to maintaining the testing infrastructure. Tests are catalogued in the OSTrails Software Tools Registry, which provides the listing below via an API call. All tests are compliant with the FTR Vocabulary and can be executed through the platforms described under Testing Platforms.

The catalogue currently lists around 200 tests, so it is kept on its own searchable page: Browse the FAIR Tests catalogue.

DMP Tests

DMP Tests are listed in the catalogue of DMP Tests. These are not maintained as “live” endpoints; rather, users are invited to select the tests of interest to them and deploy them on their own infrastructure.

FAIR Algorithms

The algorithms below are maintained as live endpoints by the OSTrails project together with private partners who are committed to maintaining the testing infrastructure. Algorithms are catalogued in the OSTrails Software Tools Registry, which provides the listing below via an API call. All algorithms are compliant with the FTR Vocabulary and can be executed through the platforms described under Testing Platforms.

The catalogue currently lists about a dozen algorithms, so it is kept on its own searchable page: Browse the FAIR Algorithms catalogue.