Hugging Face's logo

nectec
/
Pathumma-llm-vision-1.0.0

Visual Question Answering
Safetensors
Thai
English
idefics3
Model card Files Community
1
Thirawarit commited on
Commit
eec6d0c
•
1 Parent(s): e64db2b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -53,13 +53,14 @@ The model was fine-tuned on several datasets:
53
 
54
  ## Evaluation Results
55
 
56
- | Type | Encoder | Decoder | IPU24-Image Captioning <br>Sentence SacreBLEU <br>(test) |
57
- |---------------------------------------|------------------------------------|--------------------------------|-------------------------------|
58
- | Idefic3-8B-Llama3 | siglip-so400m-patch14-384 | Meta-Llama-3.1-8B-Instruct | 0.02657 |
59
- | Pathumma-llm-vision-beta-0.0.0 | siglip-so400m-patch14-384 | Meta-Llama-3.1-8B-Instruct | 13.45412 |
60
- | Pathumma-llm-vision-1.0.0 | siglip-so400m-patch14-384 | Meta-Llama-3.1-8B-Instruct | 17.66370 |
61
- | llama-3-typhoon-v1.5-8b-vision-preview | siglip-so400m-patch14-384 | Llama-3-Typhoon-1.5-8B-instruct | 8.288626 |
62
-
 
63
 
64
  - **Accuracy on Manual-VQA Tasks**: 30.34%
65
 
 
53
 
54
  ## Evaluation Results
55
 
56
+ | Type | Encoder | Decoder | IPU24-dataset <br>(test) <br>(Sentence SacreBLEU) |
57
+ |----------------------------------------|------------------------------------|-------------------------------------|-------------------------------|
58
+ | Idefic3-8B-Llama3 | siglip-so400m-patch14-384 | Meta-Llama-3.1-8B-Instruct | 0.02657 |
59
+ | Pathumma-llm-vision-beta-0.0.0 | siglip-so400m-patch14-384 | Meta-Llama-3.1-8B-Instruct | 13.45412 |
60
+ | Pathumma-llm-vision-1.0.0 | siglip-so400m-patch14-384 | Meta-Llama-3.1-8B-Instruct | **17.66370** |
61
+ | llama-3-typhoon-v1.5-8b-vision-preview | siglip-so400m-patch14-384 | Llama-3-Typhoon-1.5-8B-instruct | 8.288626 |
62
+
63
+ Note: Other models not target fine-tuned on IPU24-datasets may be less representative of IPU24 performance.
64
 
65
  - **Accuracy on Manual-VQA Tasks**: 30.34%
66