Not-For-All-Audiences

nsfw

Model card Files Files and versions Community

これは、AratakoさんのLightChatAssistant-4x7Bモデルをexl2量子化したものです。
Q4 cacheモードによる、32kのContextSize対応、4.0bpw量子化でVRAM16GBでフルロード可能です。

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for RioShiina/LightChatAssistant-4x7B-exl2

Base model

Elizezen/Antler-7B

Finetuned

(9)

this model