meta-llama/Llama-2-13b-chat-hf - W8A8_FP8 Compression
This is a compressed model using llmcompressor.
Compression Configuration
- Base Model: meta-llama/Llama-2-13b-chat-hf
- Compression Scheme: W8A8_FP8
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 4096
Sample Output
Prompt:
<s>[INST] Who is Alan Turing? [/INST]
Output:
<s><s> [INST] Who is Alan Turing? [/INST] Alan Turing (1912-1954) was a British mathematician, computer scientist, and logician who made significant contributions to the fields of computer science, mathematics, and artificial intelligence. He is widely considered to be one of the most important figures in the history of computer science and artificial intelligence.
Turing was born in London, England, and grew up in a family of mathematicians. He studied at Cambridge University, where he earned his undergraduate degree in mathematics and later earned his PhD in mathematics. During World War II, Turing worked at the Government Code and Cy
Evaluation
- Downloads last month
- 2
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for espressor/meta-llama.Llama-2-13b-chat-hf_W8A8_FP8
Base model
meta-llama/Llama-2-13b-chat-hf