Containerization support would be nice.
#1
by
HlexNC
- opened
The plan.
So, I do not like to edit the code to each machine, so my plan is to attempt to make a Dockerfile and a docker-compose file to set everything up automatically. I also plan to try and make this llama3 npu model compatible with ollama and run it on the container.
Why?
Because I can stop and start the container instance at any point of time, not problem. I already have a couple of containers web-apps running, so as to simplify my offline and plane life.
Hello!
It's certainly a pain to set up, so it would be useful.
However, the AMD driver is not yet stable, so it will be difficult to run it via Docker.