Hugging Face's logo

tsantosh7
/
Bailii-Roberta

Fill-Mask
Transformers
PyTorch
English
roberta
Inference Endpoints
Model card Files Community
1
Bailii-Roberta / README.md
tsantosh7's picture
tsantosh7
Update README.md
17b5954
preview code
|
raw
history blame
2.53 kB
metadata
license: apache-2.0
tags:
  - fill-mask
language:
  - en
widget:
  - text: >-
      He carefully assessed the financial position of the <mask> disclosed
      within its accounts, including its pension scheme liabilities.
  - text: >-
      Moreover, she had chosen not to give <mask> and therefore had not provided
      any innocent explanation of her communications.

Pre-trained Language Model for England and Wales Court of Appeal (Criminal Division) Decisions

Introduction

The research for understanding the bias in criminal court decisions need the support of natural language processing tools.

The pre-trained language model has greatly improved the accuracy of text mining in general texts. At present, there is an urgent need for a pre-trained language model specifically for the automatic processing of court decision texts.

We used the text from the Bailii website as the training set. Based on the deep language model framework of RoBERTa, we constructed bailii-roberta pre-training language model by transformers/run_mlm.py and transformers/mlm_wwm.

How to use

Huggingface Transformers

The from_pretrained method based on Huggingface Transformers can directly obtain bailii-roberta model online. 

from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("tsantosh7/bailii-roberta")

model = AutoModel.from_pretrained("tsantosh7/bailii-roberta")

Download Models

  • The version of the model we provide is PyTorch.

From Huggingface

Disclaimer

  • The experimental results presented in the report only show the performance under a specific data set and hyperparameter combination, and cannot represent the essence of each model. The experimental results may change due to the random number of seeds and computing equipment.
  • Users can use the model arbitrarily within the scope of the license, but we are not responsible for the direct or indirect losses caused by using the content of the project.

Acknowledgment