athirdpath
/

Llama-3.1-Techne-RP-8b-v1-GGUF

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Auto-loaded prompt format will not work with these GGUFs, will requant but for now you can just switch in ooba, etc

Techne-RP-8b

Trained with Llama 3 prompt formatting, Alpaca works too

Assistant Example @ q5_k_m

NSFW Writing Example @ q5_k_m

Training Methodology

athirdpath/Llama-3.1-Instruct_NSFW-pretrained_e1-plus_reddit was further trained in the order below:

SFT

Doctor-Shotgun/no-robots-sharegpt
grimulkan/LimaRP-augmented
Inv/c2-logs-cleaned-deslopped

DPO

jondurbin/truthy-dpo-v0.1
Undi95/Weyaxi-humanish-dpo-project-noemoji
athirdpath/DPO_Pairs-Roleplay-Llama3-NSFW

Downloads last month: 18

GGUF

Model size

8.03B params

Architecture

llama

4-bit

6-bit

Inference API

Unable to determine this model's library. Check the docs .

Collection including athirdpath/Llama-3.1-Techne-RP-8b-v1-GGUF

GGUF Quants - Roleplay Deployment Models

GGUF - Models I think are cool and worth using. A lot of what I make is intended only as a part in a further merge or as a test, these are the others. • 14 items • Updated Sep 3 • 3