Semialign-r128-LoRA
This is a LoRA extracted from a language model. It was extracted using mergekit.
LoRA Details
This LoRA adapter was extracted from merge/semialign and uses NousResearch/Meta-Llama-3.1-8B-Instruct as a base.
This LoRA adapter has an extended vocabulary. Make sure to call
model.resize_token_embeddings(128261)before applying the adapter to NousResearch/Meta-Llama-3.1-8B-Instruct
Parameters
The following command was used to extract this LoRA adapter:
mergekit-extract-lora merge/semialign NousResearch/Meta-Llama-3.1-8B-Instruct OUTPUT_PATH --no-lazy-unpickle --skip-undecomposable --rank=128 --extend-vocab --model_name=Semialign-r128-LoRA --verbose
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.
Model tree for kromcomp/L3.1-Semialign-r128-LoRA
Base model
NousResearch/Meta-Llama-3.1-8B-Instruct