Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ It was introduced in the paper [ColPali: Efficient Document Retrieval with Visio
|
|
23 |
|
24 |
This version is trained with `colpali-engine==0.2.0` but can be loaded for any version `>=0.2.0`.
|
25 |
|
26 |
-
Compared to `colpali
|
27 |
It also stems from the fixed `vidore/colpaligemma-3b-pt-448-base` to guarantee deterministic projection layer initialization.
|
28 |
It was trained for 5 epochs, with in-batch negatives and hard mined negatives and a warmup of 1000 steps (10x longer) to help reduce non-english language collapse.
|
29 |
|
|
|
23 |
|
24 |
This version is trained with `colpali-engine==0.2.0` but can be loaded for any version `>=0.2.0`.
|
25 |
|
26 |
+
Compared to [`vidore/colpali`](https://huggingface.co/vidore/colpali), this version is trained with right padding for queries to fix unwanted tokens in the query encoding.
|
27 |
It also stems from the fixed `vidore/colpaligemma-3b-pt-448-base` to guarantee deterministic projection layer initialization.
|
28 |
It was trained for 5 epochs, with in-batch negatives and hard mined negatives and a warmup of 1000 steps (10x longer) to help reduce non-english language collapse.
|
29 |
|