File size: 2,418 Bytes
a7fea0d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3c25e08
25a37c3
 
 
 
 
3c25e08
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
---
license: mit
---

# isy-thl/bge-reranker-base-course-skill-tuned

## Overview

This model is a finetuning of BAAI/bge-reranker-base on a German dataset containing positive and negative skill labels and learning outcomes of courses as the query. The model is trained to perform well on calculating relevance scores for learning outcome and esco skill pairs in German language.

## Using FlagEmbedding

```
pip install -U FlagEmbedding
```

Get relevance scores (higher scores indicate more relevance):
```python
from FlagEmbedding import FlagReranker
reranker = FlagReranker('isy-thl/bge-reranker-base-course-skill-tuned', use_fp16=True) # Setting use_fp16 to True speeds up computation with a slight performance degradation

scores = reranker.compute_score([['Einführung in die Arbeitsweise von WordPress', 'WordPress'], ['Einführung in die Arbeitsweise von WordPress', 'Software für Content-Management-Systeme nutzen'], ['Einführung in die Arbeitsweise von WordPress', 'Website-Sichtbarkeit erhöhen']])
print(scores)
```

The resulting scores can be normalized using a sigmoid function
```python
score = 1 / (1 + math.exp(-score))
```

## Performance

![Eval Results comparing intfloat/multilingual-e5-base, isy-thl/multilingual-e5-base-course-skill-tuned and also a version reranked with isy-thl/bge-reranker-base-course-skill-tuned](https://cdn-uploads.huggingface.co/production/uploads/64481ef1e6161a1f32e60d96/x5xqyU-_raRyVOGqGVpq-.png)


## Acknowledgments

Special thanks to the contributors from the **Institut für Interaktive Systeme**, **Kursportal Schleswig-Holstein**, **Weiterbildung Hessen eV**, **MyEduLife**, and **Trainspot** for their invaluable support and contributions to the dataset and finetuning process.

**Funding:**
This project was funded by the **Federal Ministry of Education and Research**.

<div style="display: flex; align-items: center; gap: 35px;">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/64481ef1e6161a1f32e60d96/Yy8QPa3w_lBp9XbGYEDs0.jpeg" alt="BMBF Logo" style="width: 150px; height: auto;">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/64481ef1e6161a1f32e60d96/qznw4LESrVmdm-iZdwmNq.jpeg" alt="THL Logo" style="width: 150px; height: auto;">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/64481ef1e6161a1f32e60d96/Sybom1Tr45NkHbHq75EED.png" alt="WISY@KI Logo" style="width: 150px; height: auto;">
</div>