pip install ctransformers
from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained('marella/gpt-2-ggml')

print(llm('AI is going to'))

See https://github.com/marella/ctransformers

Downloads last month
5,348
Inference API
Unable to determine this modelโ€™s pipeline type. Check the docs .

Spaces using marella/gpt-2-ggml 2