yuzhaouoe/BM25Chunk
Text Generation
•
Updated
•
363
Pre-Trianing Data Packing
[ACL'24] Analysing the Impact of Sequence Composition on Language Model Pre-Training. https://github.com/yuzhaouoe/pretraining-data-packing
-
-
yuzhaouoe/UniChunk
Text Generation • Updated • 357 -
yuzhaouoe/BM25Chunk-2048
Text Generation • Updated • 314 -
yuzhaouoe/MixChunk
Text Generation • Updated • 355 -
yuzhaouoe/IntraDoc
Text Generation • Updated • 359 -
yuzhaouoe/UniChunk-2048
Text Generation • Updated • 326 -
yuzhaouoe/MixChunk-2048
Text Generation • Updated • 328 -
yuzhaouoe/IntraDoc-2048
Text Generation • Updated • 322 -
yuzhaouoe/eval_data
Updated