Command:

uv run python -m ultravox.tools.projector_regression_tool \
  -s meta-llama/Llama-3.1-8B-Instruct -b meta-llama/Llama-3.3-70B-Instruct \
  -p fixie-ai/llama-3.3-8b-70b-projection

Training loss: Cosine + L1

Cosine sim for S2B (all, train, test):

tensor(0.4480, device='cuda:0') tensor(0.4491, device='cuda:0') tensor(0.3910, device='cuda:0')

Cosine sim for B2S (all, train, test):

tensor(0.4833, device='cuda:0') tensor(0.4845, device='cuda:0') tensor(0.3925, device='cuda:0')

Downloads last month: -; Downloads are not tracked for this model. How to track

Safetensors

Model size

33.6M params

Tensor type

F32

Inference API

Unable to determine this model’s pipeline type. Check the docs .