AI you can run yourself: local LLM runners, open-weight models, self-hosted inference servers, and the tooling around them. For anyone who prefers weights on their own hardware over a metered API.
160 tools listed · 126 added in the last 30 days · newest: Applio, Langroid, DeerFlow
Cumulative bids, uncapped. Rebid pays only the difference. Season freezes from now.
Ad disclosure: this ranking is paid advertising placement, ordered solely by cumulative captured bids (ties: earlier capture, then lowest intent id) — methodology.
| # | Tool | Season total | Min to take this spot | Clicks | CTR | CPC |
|---|
| AIChat All-in-one LLM CLI with chat, RAG, and shell assistant modes | First bid €3 → #1 |
| AIMET Qualcomm's library for neural network quantization and pruning | First bid €3 → #1 |
| Agent Zero Self-hosted general-purpose agent framework with a web UI | First bid €3 → #1 |
| AgentScope Agent-oriented programming framework | First bid €3 → #1 |
| Ai2 Truly open models (OLMo) | First bid €3 → #1 |
| Alpaca Linux desktop client for Ollama built with GTK4 | First bid €3 → #1 |
| Answer.AI R&D lab shipping practical open-source AI tools and models | First bid €3 → #1 |
| AnythingLLM All-in-one private AI app | First bid €3 → #1 |
| Aphrodite Engine High-throughput open LLM inference | First bid €3 → #1 |
| Applio Open-source voice conversion tool based on RVC | First bid €3 → #1 |
| Atomic Agents Modular Python framework for schema-driven AI agents | First bid €3 → #1 |
| Automa Open-source browser workflow automation | First bid €3 → #1 |
| Axolotl Post-training toolkit for open models | First bid €3 → #1 |
| BGE (FlagEmbedding) BAAI's open BGE embedding and reranker model family, widely used in RAG retrieval pipelines | First bid €3 → #1 |
| BeeAI Framework Open-source agent framework in Python and TypeScript | First bid €3 → #1 |
| Burn Deep learning framework written in Rust | First bid €3 → #1 |
| Candle (Hugging Face) Minimalist Rust ML framework | First bid €3 → #1 |
| Chai Discovery Open frontier models for molecular structure | First bid €3 → #1 |
| ChatTTS Open TTS model optimized for conversational dialogue speech in English and Chinese | First bid €3 → #1 |
| Chatbox Desktop and mobile client for chatting with local and cloud AI models | First bid €3 → #1 |
| Chatterbox Resemble AI's open TTS with voice cloning | First bid €3 → #1 |
| Cherry Studio Open-source desktop client supporting many LLM providers and assistants | First bid €3 → #1 |
| DVC Open-source data and model versioning | First bid €3 → #1 |
| DataLine Chat with your data, privately | First bid €3 → #1 |
| DeerFlow ByteDance's open-source deep research agent framework | First bid €3 → #1 |
| DocsGPT Self-hostable open-source RAG assistant for chatting with your documents and knowledge bases | First bid €3 → #1 |
| EasyOCR Python OCR library with ready-to-use recognition models covering 80+ languages | First bid €3 → #1 |
| EleutherAI Open-source AI research collective | First bid €3 → #1 |
| EvolutionaryScale ESM frontier models for biology | First bid €3 → #1 |
| ExLlamaV2 Fast local inference for quantized LLMs | First bid €3 → #1 |
| ExecuTorch PyTorch runtime for on-device inference | First bid €3 → #1 |
| Filigran Open-source threat intel (OpenCTI) and attack simulation tools | First bid €3 → #1 |
| Frigate Local AI object detection for security cameras | First bid €3 → #1 |
| GPT4All (Nomic) Run LLMs on your desktop | First bid €3 → #1 |
| GPTQModel Maintained GPTQ quantization toolkit for LLMs, the successor to AutoGPTQ | First bid €3 → #1 |
| GPUStack Open-source GPU cluster manager for AI models | First bid €3 → #1 |
| Gemma (Google) Google's family of open-weight language models built from Gemini research and technology | First bid €3 → #1 |
| Higgs Audio Boson AI's open audio foundation model for expressive speech | First bid €3 → #1 |
| Hugging Face Optimum Toolkit to optimize and quantize models for target hardware | First bid €3 → #1 |
| IPEX-LLM Accelerate local LLMs on Intel GPUs and NPUs | First bid €3 → #1 |
| Immich Self-hosted photos with local AI search | First bid €3 → #1 |
| InternVL Open-source multimodal vision-language model family | First bid €3 → #1 |
| Jan Open-source AI assistant that runs offline | First bid €3 → #1 |
| K8sGPT Kubernetes diagnostics with AI | First bid €3 → #1 |
| KTransformers Run huge MoE models on limited local hardware | First bid €3 → #1 |
| Karakeep Self-hosted bookmarking app with AI tagging and search | First bid €3 → #1 |
| Keep Open-source AIOps and alert management | First bid €3 → #1 |
| Keras Multi-backend deep learning framework | First bid €3 → #1 |
| Kiln Free app for fine-tuning and synthetic data | First bid €3 → #1 |
| KoboldCpp Single-file local LLM inference | First bid €3 → #1 |
| Kohya_ss GUI Gradio GUI for Kohya's Stable Diffusion training scripts, widely used for LoRA training | First bid €3 → #1 |
| Kotaemon Open-source clean RAG UI for chatting with your documents | First bid €3 → #1 |
| Krita AI Diffusion Krita plugin for AI inpainting and image generation using a local Stable Diffusion/ComfyUI backend | First bid €3 → #1 |
| LLM (Datasette) CLI for local and remote LLMs | First bid €3 → #1 |
| LLM Compressor Quantize and compress models for vLLM serving | First bid €3 → #1 |
| LLMWare Open-source RAG with small models | First bid €3 → #1 |
| LM Studio Discover and run local LLMs | First bid €3 → #1 |
| LMQL Programming language for LLM interaction | First bid €3 → #1 |
| LangGraph LangChain's open-source framework for building stateful, graph-structured agent workflows | First bid €3 → #1 |
| Langroid Python framework for multi-agent LLM programming | First bid €3 → #1 |
| Lemonade Local LLM server tuned for AMD NPUs and GPUs | First bid €3 → #1 |
| LibreChat Open-source AI chat platform | First bid €3 → #1 |
| LibreTranslate Self-hosted open-source machine translation API powered by Argos Translate | First bid €3 → #1 |
| LlamaEdge Run LLMs across devices on a Wasm runtime | First bid €3 → #1 |
| LobeChat Open-source chat UI supporting many model providers, plugins, and self-hosting | First bid €3 → #1 |
| LocalAI OpenAI-compatible local inference API | First bid €3 → #1 |
| MLC LLM Run LLMs natively on any device | First bid €3 → #1 |
| MLX (Apple) ML framework for Apple silicon | First bid €3 → #1 |
| Marker Converts PDFs and office documents to Markdown, JSON, and HTML using layout and OCR models | First bid €3 → #1 |
| Marvin Pythonic framework for agentic AI | First bid €3 → #1 |
| MetaGPT Multi-agent framework: AI software company | First bid €3 → #1 |
| MinerU Open-source PDF extraction tool that turns documents into LLM-ready Markdown and JSON | First bid €3 → #1 |
| MiniCPM-V OpenBMB's open multimodal model series for efficient on-device image, video, and text understanding | First bid €3 → #1 |
| Mirascope Python toolkit for LLM applications | First bid €3 → #1 |
| Modular MAX and Mojo — AI compute platform | First bid €3 → #1 |
| Moondream Tiny open vision language model | First bid €3 → #1 |
| Msty Local-first AI chat app | First bid €3 → #1 |
| NVIDIA NeMo NVIDIA's open-source framework for training, customizing, and deploying generative AI and speech models | First bid €3 → #1 |
| Nexa AI On-device multimodal inference | First bid €3 → #1 |
| NextChat Open-source cross-platform chat UI for multiple LLM providers | First bid €3 → #1 |
| ONNX Runtime Cross-platform ML inference accelerator | First bid €3 → #1 |
| Ollama Run LLMs locally | First bid €3 → #1 |
| Open Climate Fix Open-source ML for solar forecasting and grid decarbonization | First bid €3 → #1 |
| Open WebUI Self-hosted AI interface | First bid €3 → #1 |
| Open-Sora Open-source text-to-video generation model and pipeline | First bid €3 → #1 |
| OpenLIT Open-source AI engineering observability | First bid €3 → #1 |
| OpenLLM Run open-source LLMs as OpenAI-compatible API endpoints | First bid €3 → #1 |
| OpenManus Open-source framework for building general AI agents | First bid €3 → #1 |
| OpenVINO Intel open-source toolkit for optimizing and running AI inference on CPUs and edge | First bid €3 → #1 |
| Opentrons Open-source lab robots for pipetting and automation | First bid €3 → #1 |
| Oumi Open-source platform for training, evaluating, and deploying foundation models | First bid €3 → #1 |
| Outlines Structured LLM generation | First bid €3 → #1 |
| PEFT (Hugging Face) Hugging Face library for parameter-efficient fine-tuning of LLMs with LoRA, QLoRA, and related methods | First bid €3 → #1 |
| PaddleOCR Open-source multilingual OCR toolkit | First bid €3 → #1 |
| Page Assist Browser extension sidebar for chatting with local AI models | First bid €3 → #1 |
| ParadeDB Postgres for search and analytics | First bid €3 → #1 |
| Phi (Microsoft) Microsoft's family of small language models with MIT-licensed open weights | First bid €3 → #1 |
| Pinokio One-click local AI installer | First bid €3 → #1 |
| Piper Fast local neural text-to-speech system | First bid €3 → #1 |
| PyGPT Open-source desktop AI assistant | First bid €3 → #1 |
| PyTorch Open-source deep learning framework | First bid €3 → #1 |
| RWKV Attention-free RNN language model architecture with open-weight models and linear-time inference | First bid €3 → #1 |
| RamaLama Run AI models via containers | First bid €3 → #1 |
| Rasa Open framework for conversational AI | First bid €3 → #1 |
| Reor Local AI note app with private RAG | First bid €3 → #1 |
| Rerun Open-source visualization for robotics and multimodal data | First bid €3 → #1 |
| SAM 2 Meta's open model for promptable image and video segmentation | First bid €3 → #1 |
| SGLang Fast open-source LLM serving engine | First bid €3 → #1 |
| STORM Stanford's open-source system that researches topics into cited reports | First bid €3 → #1 |
| Screenpipe Open-source local screen recording for AI context | First bid €3 → #1 |
| Sentence Transformers Python framework for training and running embedding and reranker models for semantic search | First bid €3 → #1 |
| SillyTavern Open-source frontend for chatting and roleplay with local and API LLMs | First bid €3 → #1 |
| SmolLM (Hugging Face) Hugging Face's family of compact open-weight language and vision models for on-device use | First bid €3 → #1 |
| Sourcebot Open-source code search and ask | First bid €3 → #1 |
| Spark-TTS Open-source LLM-based TTS model with zero-shot voice cloning | First bid €3 → #1 |
| Stable Diffusion WebUI Local diffusion image UI | First bid €3 → #1 |
| SwarmUI Modular open-source web UI for image and video diffusion models with a ComfyUI backend | First bid €3 → #1 |
| TII Falcon Open Falcon model family | First bid €3 → #1 |
| Text Generation Inference Hugging Face toolkit for serving LLMs in production | First bid €3 → #1 |
| Text Generation WebUI Gradio UI for local LLMs | First bid €3 → #1 |
| Transformer Lab Open-source workspace to download, tune, and chat with LLMs locally | First bid €3 → #1 |
| Transformers (Hugging Face) The model-definition library | First bid €3 → #1 |
| Transformers.js Run Hugging Face models in the browser | First bid €3 → #1 |
| Triton Inference Server NVIDIA's open-source inference server for serving models from any framework on GPU or CPU | First bid €3 → #1 |
| Typesense Open-source search with vectors | First bid €3 → #1 |
| USearch Compact vector search engine library for many languages | First bid €3 → #1 |
| Unsloth Fast fine-tuning of open models | First bid €3 → #1 |
| Upscayl Free open-source AI image upscaler | First bid €3 → #1 |
| Vanna AI Open-source text-to-SQL agent | First bid €3 → #1 |
| Verba (Weaviate) Open-source RAG chatbot by Weaviate | First bid €3 → #1 |
| Vosk Offline speech recognition for 20+ languages | First bid €3 → #1 |
| Wave Terminal Open-source terminal with AI built in | First bid €3 → #1 |
| WebLLM In-browser LLM inference via WebGPU | First bid €3 → #1 |
| WhisperKit On-device Whisper speech recognition for Apple platforms | First bid €3 → #1 |
| WhisperX Whisper ASR with word timestamps and diarization | First bid €3 → #1 |
| Wren AI Open-source GenBI agent | First bid €3 → #1 |
| Zylon (PrivateGPT) Private AI workspace on-prem | First bid €3 → #1 |
| big-AGI Open-source multi-model AI chat suite | First bid €3 → #1 |
| bitsandbytes 8-bit and 4-bit quantization for PyTorch | First bid €3 → #1 |
| comma.ai Maker of openpilot, open-source driver-assistance that runs on consumer hardware | First bid €3 → #1 |
| exo Run models across your own devices | First bid €3 → #1 |
| faster-whisper Whisper inference reimplemented on CTranslate2 | First bid €3 → #1 |
| ggml Tensor library behind llama.cpp | First bid €3 → #1 |
| gpt-oss (OpenAI) OpenAI's Apache-2.0 open-weight models, gpt-oss-120b and gpt-oss-20b, for local and self-hosted use | First bid €3 → #1 |
| kagent Open framework for running AI agents in Kubernetes | First bid €3 → #1 |
| llama-swap Proxy that hot-swaps llama.cpp models on demand | First bid €3 → #1 |
| llama.cpp LLM inference in C/C++ | First bid €3 → #1 |
| llamafile (Mozilla) Distribute LLMs as one file | First bid €3 → #1 |
| lm-evaluation-harness EleutherAI's framework for few-shot evaluation of language models across hundreds of benchmark tasks | First bid €3 → #1 |
| marimo Reactive Python notebooks with AI | First bid €3 → #1 |
| mistral.rs Cross-platform LLM inference engine in Rust | First bid €3 → #1 |
| ncnn Tencent's mobile neural net inference framework | First bid €3 → #1 |
| oterm Terminal chat client for Ollama with tool support | First bid €3 → #1 |
| pgai Adds embedding and LLM workflows to PostgreSQL | First bid €3 → #1 |
| smolagents Minimal library for code-acting AI agents | First bid €3 → #1 |
| spaCy Industrial-strength open-source NLP library for Python with pretrained pipelines for many languages | First bid €3 → #1 |
| sqlite-vec SQLite extension for storing and querying vectors | First bid €3 → #1 |
| tinygrad Minimalist deep learning framework | First bid €3 → #1 |
| txtai Open-source embeddings database and RAG | First bid €3 → #1 |
| whisper.cpp Local Whisper speech-to-text in C/C++ | First bid €3 → #1 |