---
library_name: transformers
license: apache-2.0
language:
- hu
base_model:
- google/mt5-large
---

# Model Card for mT5-large-HuAMR

<!-- Provide a quick summary of what the model is/does. -->


## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->

This model is a fine-tuned version of [google/mt5-large](https://huggingface.co/mt5-large) on the translated AMR 3.0 and HuAMR dataset. It achieves the following results on the evaluation set:

- **Model type:** Abstract Meaning Representation parser
- **Language(s) (NLP):** Hungarian

### Model Sources [optional]

<!-- Provide the basic links for the model. -->

- **Repository:** [GitHub Repo](https://github.com/botondbarta/HuAMR)

## Training Details

### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

#### Training Hyperparameters

- learning_rate: 5e-05
- train_batch_size: 1
- gradient_accumulation_steps: 16
- total_train_batch_size: 16
- optimizer: AdamW
- lr_scheduler_type: linear
- max_grad_norm: 0.3

#### Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

## Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

## Framework versions
 - Transformers 4.34.1
 - Pytorch 2.3.0+cu118
 - Datasets 2.19.0
 - Tokenizers 0.19.1