Ali Altıparmak's picture

9 1 4

Ali Altıparmak

ali6parmak

·

ali6parmak

AI & ML interests

None yet

Recent Activity

updated a Space 14 days ago

ali6parmak/First_agent_template

upvoted a paper 23 days ago

Executable Code Actions Elicit Better LLM Agents

reacted to mitkox's post with 👍 about 1 month ago

llama.cpp is 26.8% faster than ollama. I have upgraded both, and using the same settings, I am running the same DeepSeek R1 Distill 1.5B on the same hardware. It's an Apples to Apples comparison. Total duration: llama.cpp 6.85 sec <- 26.8% faster ollama 8.69 sec Breakdown by phase: Model loading llama.cpp 241 ms <- 2x faster ollama 553 ms Prompt processing llama.cpp 416.04 tokens/s with an eval time 45.67 ms <- 10x faster ollama 42.17 tokens/s with an eval time of 498 ms Token generation llama.cpp 137.79 tokens/s with an eval time 6.62 sec <- 13% faster ollama 122.07 tokens/s with an eval time 7.64 sec llama.cpp is LLM inference in C/C++; ollama adds abstraction layers and marketing. Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

View all activity

Organizations

ali6parmak's activity

liked a Space about 1 month ago

APISR

Enhance low-resolution anime images

liked a model about 1 month ago

hexgrad/Kokoro-82M

Text-to-Speech • Updated 25 days ago • 1.22M • 3.44k

liked a model 9 months ago

HURIDOCS/pdf-document-layout-analysis

Updated Jan 22 • 616 • 72

liked a model over 1 year ago

HURIDOCS/pdf-segmentation

Updated Jul 9, 2024 • 39