jinymusim commited on
Commit
b524abd
·
1 Parent(s): f70c703

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -1,3 +1,41 @@
1
  ---
2
  license: mit
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ language:
4
+ - cs
5
  ---
6
+
7
+ ### Czech Poetry GPT
8
+ GPT2 finetuned on Czech poetry from github project by
9
+ Institute of Czech Literature, Czech Academy of Sciences.
10
+
11
+ https://github.com/versotym/corpusCzechVerse
12
+
13
+ ## Usage
14
+
15
+ Use as any other GPT2 style model
16
+
17
+ ```python
18
+ from transformers import AutoModelForCausalLM, AutoTokenizer
19
+ import torch
20
+
21
+ tokenizer = AutoTokenizer.from_pretrained("gpt")
22
+ model = AutoModelForCausalLM.from_pretrained("jinymusim/dialogmodel")
23
+
24
+ # Input Poet Start
25
+ poet_start = "Byl pozdní večer první máj."
26
+ poet_start = poet_start.strip()
27
+ tokenized_poet_start = tokenizer.encode(poet_start + tokenizer.eos_token, return_tensors='pt')
28
+
29
+ # generated a continuation to it
30
+ out = model.generate(tokenized_poet_start,
31
+ max_length=1000,
32
+ num_beams=2,
33
+ no_repeat_ngram_size=2,
34
+ early_stopping=True,
35
+ pad_token_id=self.tokenizer.eos_token_id)
36
+
37
+ # Decode Poet
38
+ decoded_cont = self.tokenizer.decode(out[0], skip_special_tokens=True)
39
+
40
+ print(decoded_cont)
41
+ ```