jukofyork

/

creative-writing-control-vectors-v3.0

like 13

Are these control vectors compatible with Oobabooga?

I'm not sure as never used Oobabooga - if it just wraps llama.cpp then possibly?

I've looked and I can't figure out a way to do it.. Same with koboldcpp, which is a shame as LlamaCpp is PITA on Windows.

Are these control vectors compatible with Oobabooga?

I'm not sure as never used Oobabooga - if it just wraps llama.cpp then possibly?

I may have to give llama.cpp a go. These control vectors sound like they would be fun to use. Thanks for your efforts on setting these up!

I've looked and I can't figure out a way to do it.. Same with koboldcpp, which is a shame as LlamaCpp is PITA on Windows.

They have an open issue on github https://github.com/LostRuins/koboldcpp/issues/1002. Maybe make some noise so they add them? Shouldn't be difficult since kobold is based on llama.cpp

I've looked and I can't figure out a way to do it.. Same with koboldcpp, which is a shame as LlamaCpp is PITA on Windows.

They have an open issue on github https://github.com/LostRuins/koboldcpp/issues/1002. Maybe make some noise so they add them? Shouldn't be difficult since kobold is based on llama.cpp

Done :)