KoboldCpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
Why it is included
koboldcpp-1.111.1 Gemma 4 models are now supported. Note that Gemma 4 is very format sensitive, using the wrong format will likely cause bad outputs. If you want to ensure the correct format is us...
Best for
Users exploring vetted FOSS alternatives in this space (manager).
Strengths
- ~9,935 GitHub stars (per upstream list)
- Open source
Limitations
- Verify license, platform support, and security posture for your environment.
Good alternatives
Related tools
AI & Machine Learning
Open Intepreter
A natural language interface for computers
AI & Machine Learning
screenpipe
run agents that work for you in the background based on what you do
AI & Machine Learning
gptme
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
AI & Machine Learning
WrenAI
Open-source text-to-SQL and text-to-chart GenBI agent with a semantic layer. Ask your database questions in natural language — get accurate SQL, charts, and BI insights. Supports 12+ data sources (PostgreSQL, BigQuery, Snowflake, etc.) and any LLM (OpenAI, Claude, Gemini, Ollama)
AI & Machine Learning
TEN Agent
Open-source framework for conversational voice AI agents
AI & Machine Learning
Huginn
Create agents that monitor and act on your behalf. Your agents are standing by!