Spaces:
Running
Running
File size: 858 Bytes
067b01b bc795dc 067b01b bc795dc f3524c6 bc795dc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
title: README
emoji: 💻
colorFrom: green
colorTo: blue
sdk: static
pinned: false
---
A Master Thesis project by John Oskar Holmen Skjeldrum & Peder Tanberg, researching GPT models in low-resourced languages.
University: Copenhagen Business School | Program: Business Administration & Data Science
Research Questions:
1. To what extent can a GPT-j model, trained on a corpus of Norwegian language data, effectively compete with larger models in performing downstream tasks, given the inherent low-resource characteristics of the Norwegian Language?
2. What are the multifaceted challenges and inherent limitations associated with fine-tuning the existing Norwegian GPT-j model employing a limited instruction dataset and constrained resources in terms of time and computational power, and how do these factors impact the performance of the model? |