Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
microsoft
/
MInference
like
58
Running
on
Zero
App
Files
Files
Community
3
main
MInference
/
minference
/
modules
1 contributor
History:
2 commits
iofu728
Feature(MInference): update the pycuda
24083d5
5 months ago
inf_llm.py
Safe
44.7 kB
Feature(MInference): build demo
5 months ago
minference_forward.py
Safe
40.7 kB
Feature(MInference): update the pycuda
5 months ago
snap_kv.py
Safe
16.6 kB
Feature(MInference): build demo
5 months ago