iwaitu
/

llama-3.1-70b-chinese-chat-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

llama-3.1-70b-chinese-chat-FP8 / README.md

iwaitu's picture

Update README.md

f23ed53 verified 6 months ago

|

history blame contribute delete

220 Bytes

	---
	license: apache-2.0
	language:
	- zh
	- en
	base_model: shenzhi-wang/Llama3.1-70B-Chinese-Chat
	---

	base on shenzhi-wang/Llama3.1-70B-Chinese-Chat

	推荐使用 2x H100 来运行

	或者使用4x RTX6000 ADA 48G 来运行