Kyle Sayers's picture

11 2 2

Kyle Sayers

kylesayrs

·

https://github.com/kylesayrs

AI & ML interests

Accelerating ML inference @ Red Hat

Recent Activity

new activity 1 day ago

moonshotai/Moonlight-16B-A3B:Fix generation with latest transformers

new activity 1 day ago

deepseek-ai/DeepSeek-V3:Fix generation with latest transformers

new activity 1 day ago

deepseek-ai/DeepSeek-V3:Fix generation with latest transformers

View all activity

Organizations

kylesayrs's activity

New activity in moonshotai/Moonlight-16B-A3B 1 day ago

Fix generation with latest transformers

#1 opened 1 day ago by

New activity in deepseek-ai/DeepSeek-V3 1 day ago

Fix generation with latest transformers

#87 opened 1 day ago by

Fix generation with latest transformers

#88 opened 1 day ago by

New activity in microsoft/Phi-3-vision-128k-instruct 13 days ago

[Bug] Model Breaking Dynamic Cache

#69 opened 13 days ago by

New activity in mistral-community/pixtral-12b 19 days ago

Getting shape mismatch while loading saved Pixtral model

#24 opened 21 days ago by

New activity in nm-testing/NVLM-D-72B-FP8-dynamic about 1 month ago

Loading Model

#1 opened about 1 month ago by

New activity in THUDM/glm-4v-9b about 1 month ago

Fix tokenizer reloading

#42 opened about 1 month ago by

How to run the Int4 quantized model？

#10 opened 9 months ago by

fix image size unchangeable

#32 opened 8 months ago by

Tokenizer参数保存到本地之后再重新读入会所改变？

#35 opened 5 months ago by

New activity in nm-testing/pixtral-12b-w4a16-actorder-group about 2 months ago

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened about 2 months ago by

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened about 2 months ago by