nsarrazin HF staff commited on
Commit
eada88b
·
verified ·
1 Parent(s): bd476a9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - nsarrazin/lichess-games-2023-01
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - chess
8
+ ---
9
+
10
+ A 231M parameter base model trained on lichess games from January 2023 that ended in checkmate (filtered out games that were won because of time).
11
+
12
+ It's trained on sequences of UCI moves, inference is pretty simple:
13
+
14
+ ```py
15
+ from transformers import GPT2LMHeadModel, AutoTokenizer
16
+
17
+ model = GPT2LMHeadModel.from_pretrained("nsarrazin/chessformer").eval()
18
+ tokenizer = AutoTokenizer.from_pretrained("nsarrazin/chessformer")
19
+
20
+ moves = " ".join(["e2e4", "e7e5", "d2d4", "d7d5"])
21
+
22
+ model_inputs = tokenizer(moves, return_tensors="pt")
23
+ gen_tokens = model.generate(**model_inputs, max_new_tokens=1)[0]
24
+ next_move = tokenizer.decode(gen_tokens[-1])
25
+
26
+ print(next_move) #d4e5
27
+ ```
28
+
29
+