1.0 KiB
1.0 KiB
Ollama bot
After deploy:
WebUI for Ollama:
- http://localhost:8888
- use to install models like llama2, llama3 (https://ollama.com/library)
Frontend
- simple FE: http://localhost:5000/
Stack
- Gitea actions + Google lighthouse
- Gitea actions + Playright
- Nuxt.js + Bootstrap 5
Backend:
Stack
- FastAPI
- RabbitMQ/Kafka?
- OpenSearch
Push image
docker login registry.tobiasweise.dev
docker-compose push
#sudo docker tag llm-python-backend nucberlin:5123/llm-python-backend
#sudo docker push nucberlin:5123/llm-python-backend
Ideas
Knowledge graph creation
clean dangling images
sudo docker rmi $(sudo docker images -f "dangling=true" -q)
Give just the translation of the given input to German and nothing else.