metadata

language:
  - en
datasets:
  - pubmed
metrics:
  - f1
pipeline_tag: text-classification
widget:
  - text: >-
      Many pathogenic processes and diseases are the result of an erroneous
      activation of the complement cascade and a number of inhibitors of
      complement have thus been examined for anti-inflammatory actions.
    example_title: BACKGROUND example
  - text: A total of 192 MI patients and 140 control persons were included.
    example_title: METHODS example
  - text: >-
      MI patients had 18 % higher plasma levels of MAp44 (IQR 11-25 %) as
      compared to the healthy control group (p < 0. 001.)
    example_title: RESULTS example
  - text: >-
      The finding that a brief CB group intervention delivered by real-world
      providers significantly reduced MDD onset relative to both brochure
      control and bibliotherapy is very encouraging, although effects on
      continuous outcome measures were small or nonsignificant and approximately
      half the magnitude of those found in efficacy research, potentially
      because the present sample reported lower initial depression.
    example_title: CONCLUSIONS example
  - text: >-
      In order to understand and update the prevalence of myopia in Taiwan, a
      nationwide survey was performed in 1995.
    example_title: OBJECTIVE example

scibert-scivocab-cased_pub_section

original model file name: textclassifer_scibert_scivocab_cased_pubmed_20k
This is a fine-tuned checkpoint of allenai/scibert_scivocab_cased for document section text classification
possible document section classes are:BACKGROUND, CONCLUSIONS, METHODS, OBJECTIVE, RESULTS,

metadata

training_metrics

date_run: Apr-26-2022_t-13
huggingface_tag: allenai/scibert_scivocab_cased
test_set: [{'test_accuracy': 0.8313589096069336, 'test_matthewscorrcoef': 0.7736952900886536, 'test_f1score': 0.8317078948020935, 'test_cross_entropy': 0.5242752432823181}]

training_parameters

NUM_EPOCHS: 12
BATCH_SIZE: 32
MAX_INPUT_LENGTH: 256
TRAIN_FP16: True
TRAIN_STRATEGY: freeze
LR_SCHEDULE: reducelronplateau
LR_INITIAL: 0.001
WEIGHT_DECAY: 0.05
UNFREEZE_EPOCH: 4
hf_tag: allenai/scibert_scivocab_cased
lowercased_input: False
input_text_colname: description
target_cls_colname: target
num_classes: 5
model_shortname: scibert_scivocab_cased