My first ever successful merge: QueenLiz 120B
this is a linear merge of Quartet70B (https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001) and Lzlv 70B (https://huggingface.co/lizpreciatior/lzlv_70b_fp16_hf)
Sharing it here so hopefully someone else with proper machine can try this out.
NOTE: Context Window should be 32K
GGUF versions of some quants will be uploaded here:https://huggingface.co/Noodlz/QueenLiz-120B-GGUF (aiming to have at least Q4KM in here)
base_model:
- alchemonaut/QuartetAnemoi-70B-t0.0001
- lizpreciatior/lzlv_70b_fp16_hf library_name: transformers tags:
- mergekit
- merge
output_folder
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge: