Adding `safetensors` variant of this model
#48 opened 11 months ago
by
SFconvertbot

多伦对话,如何将背景信息,人设设定添加进去
#47 opened about 1 year ago
by
leilei22

AttributeError: 'BaichuanTokenizer' object has no attribute '_in_target_context_manager'
#46 opened about 1 year ago
by
DavidRay000977
使用 3090 显卡本地部署 baichuan2-13b-chat 非量化版,有人成功过没?
#45 opened about 1 year ago
by
catlenmao
Update tokenization_baichuan.py
#44 opened about 1 year ago
by
Beilei518
Baichuan doesn't work well when use AutoModelForCausalLM.from_config
#43 opened about 1 year ago
by
baodii
update modeling_baichuan.py for torchscript mode with past_kv
#42 opened about 1 year ago
by
changwangss
请问这两个文件quantizer.py和generation_utils.py为什么没有下载
#41 opened over 1 year ago
by
zhangqin28
有32k的么?或者更大的
1
#40 opened over 1 year ago
by
LycheeX

请问int8 和 int4 用的量化方法是什么啊?
1
#39 opened over 1 year ago
by
frankxyy
[AUTOMATED] Model Memory Requirements
#38 opened over 1 year ago
by
model-sizer-bot
怎么从本地加载模型呢?
3
#37 opened over 1 year ago
by
yizhiezi
Unable to load weights from pytorch checkpoint file
#36 opened over 1 year ago
by
xiaofengzheng
13B的8bit量化版的下载链接咋没了呢
1
#35 opened over 1 year ago
by
pbjacob
v2版本大概啥时候能开源出来
3
#33 opened over 1 year ago
by
Winkuis
Model Export to ONNX format
2
#32 opened over 1 year ago
by
Desjajja
关于量化8bits的推理速度
#31 opened over 1 year ago
by
hanswang73
重复问题
#30 opened over 1 year ago
by
hanswang73
自问自答
#29 opened over 1 year ago
by
Xingloooooong

The model 'BaichuanForCausalLM' is not supported for text-generation.
#28 opened over 1 year ago
by
fuliu2023
有支持FasterTransformer的计划吗?
3
#27 opened over 1 year ago
by
Hunter1943
英文推理报错
19
#26 opened over 1 year ago
by
hanswang73
有nl2sql的prompt示例吗
#25 opened over 1 year ago
by
boundles
用英语提问,默认回答的是中文
1
#24 opened over 1 year ago
by
xdstack
大家百川13b 推理加速是怎么做的?
2
#23 opened over 1 year ago
by
yy520xxr
请问, 模型量化后如何保存,直接使用 save_pretrained 保存下来的不太正确只有1.3G
2
#22 opened over 1 year ago
by
agoto
Add flash attention
7
#21 opened over 1 year ago
by
yuanzhoulvpi

跑这个需要什么机器配置,AMD 68xt能行?
1
#18 opened over 1 year ago
by
xebk
The sdk for running demo code.
#17 opened over 1 year ago
by
ljni

什么时候可以出baichuan-33B的版本呢
1
#13 opened over 1 year ago
by
DCTR
3060 12g demo代码可以跑起来 4090 24g内存溢出
6
#12 opened over 1 year ago
by
duketxl
能否出个deepspeed的微调DEMO
#11 opened over 1 year ago
by
robinzyx
设定的角色有哪些?
2
#9 opened over 1 year ago
by
feifeiyechuan

关于数据集的疑问
#7 opened over 1 year ago
by
ShadowPower
