OSTrails DELIVERABLE 3.2: Toolbox of Testing Services

The OSTrails Interoperability Framework defines a variety of digital objects that represent the conceptual and code-level artefacts in the assessment space. At the conceptual level are Metrics and Benchmarks. At the code level are Tests and Algorithms.

It is also important to distinguish between the code of a service and its deployment as an active endpoint. Generally speaking, DMP tests are provided as code-level objects in the project GitHub and do not exist as public services. In the case of FAIR tests, these have been adopted by a commercial entity and will be updated and maintained as active endpoints beyond the end of the OSTrails project. As such, the lists of Tests below differs slightly between the DMP Tests (code) and the FAIR Tests (active endpoints). Both FAIR tests and DMP tests are compliant with the FTR Vocabulary, and are thus interoperable.

Toolbox

• FAIR Metrics
• DMP Metrics
• FAIR Tests
• DMP Tests
• FAIR Benchmarks
• FAIR Algorithms
• FAIR Testing Platforms
• DMP Assessment Tools
• SKG Tools

In addition to testing and assessment tools, the OSTrails project has also developed a number of other tools that support the testing ecosystem. These include:

Supporting Tools

• Assessment Authoring and Registration Tools
• Validation and Quality Control Tools