Skip to content

Module contributor

This section is dedicated for module contributors, basic users that would like to add a new module (dataset, method, metric) to an existing Omnibenchmark. This section will show how to add a new module to an existing Omnibenchmark.

This section will not show you how to create/ setup an Omnibenchmark (see the Benchmarker section) and how to visualize and interpret the evaluation results (see the Method user section).

Warning

Before starting, make sure that you have;

  1. Created an account to access Renku;

  2. Requested an access to the Omnibenchmark Gitlab group (Request Access button. If you don't see it, you were already granted access to it);

  3. A script for importing data, or a wrapper of a method or a metric.