DevQuasar/allenai.Llama-3.1-Tulu-3-405B-GGUF
Text Generation
•
Updated
•
76
Csaba Kecskemeti PRO
csabakecskemeti
AI & ML interests
None yet
Recent Activity
updated
a model
about 1 hour ago
DevQuasar/allenai.Llama-3.1-Tulu-3-405B-GGUF
replied to
their
post
about 3 hours ago
Check out my idea:
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
updated
a model
about 3 hours ago
DevQuasar/mkurman.Qwen2.5-14B-DeepSeek-R1-1M-GGUF
Organizations
csabakecskemeti's activity
updated
a
model
about 1 hour ago
replied to
their
post
about 3 hours ago
This is obviously a prototype.
Security is a big concern here, but is believe it’s possible to put together a proxy that is safe and does not allow anything else than forward generate requests between browser and local llm.
updated
2
models
about 3 hours ago
updated
a
model
about 4 hours ago
updated
a
model
about 14 hours ago
published
a
model
about 14 hours ago
published
2
models
about 16 hours ago
published
a
model
about 18 hours ago
updated
a
collection
about 18 hours ago
updated
a
model
about 18 hours ago
published
a
model
about 21 hours ago
posted
an
update
1 day ago
Post
765
Check out my idea:
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
-
- 1 reply
updated
2
models
2 days ago
updated
3
datasets
2 days ago