반응형
Env
Install nvidia docker env toolkit
Run
$ docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollamaExecute
$ docker exec -it ollama ollama run llama3.1:8bhelp
>>> /?Exit
>>> /bye
or
ctrl + dllama3.1 taglist
https://ollama.com/library/llama3.1/tags
Tags · llama3.1
Llama 3.1 is a new state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.
ollama.com
반응형
'개발, 웹, 블로그 > DeepLearning 상식' 카테고리의 다른 글
| llama-stack 설치하였으나 llama 명령어가 없을때 (0) | 2024.10.28 |
|---|---|
| Ubuntu에서 nvidia-docker2 설치 (0) | 2024.10.11 |
| docker: Error response from daemon: unknown or invalid runtime name: nvidia. 오류 (0) | 2024.09.25 |