Model Managers

Model managers are runtime environments for running and managing large language models locally. They provide tooling for model management, deployment, configuration, and inference optimization—allowing you to run open-source models on your own hardware with ease.

• Ollama
• LM Studio
• Unsloth – Run and fine-tune LLMs locally with optimized custom kernels (2× faster training, ~90% less memory). Supports 500+ text, vision, audio, and embedding models; export to GGUF/Safetensors for llama.cpp, vLLM, and Ollama.