Hugging Face's logo

gmongaras
/
Softmax_Attention_GPT_1.2B

Feature Extraction
gptj
Model card Files Community
gmongaras commited on
Commit
f1ecb70
•
1 Parent(s): 5b5ff0f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -1,3 +1,6 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: feature-extraction
4
+ ---
5
+
6
+ This repository contains the GPT-1.2b described in [Cottention: Linear Transformers With Cosine Attention](https://huggingface.co/papers/2409.18747).