RSS Feed

Day Week Month Year
All r/AI_Agents r/AI_Governance r/ClaudeAI r/ClaudeCode r/DeepSeek r/Futurology r/LangChain r/LocalLLaMA r/MachineLearning r/OpenAI r/artificial r/cybersecurity r/europe r/hermesagent r/netsec r/singularity r/technology

1210 items in r/LocalLLaMA

04.09.2026
r/LocalLLaMA I built a server with 768GB VRAM for frontier, but all new frontier open source models are likely to be two trillion or above now, including next GLM 6, am I cooked? 🔗
r/LocalLLaMA Model: add Tencent Hy 4 (hy_v4) preview architecture support by Little0o0 · Pull Request #28127 · ggml-org/llama.cpp 🔗
r/LocalLLaMA Qwen 3.8 Flash Next Can Build Funny Games 🔗
r/LocalLLaMA Even Qwen3.8 followed the instruction inside my translation data, and Gemma 4 beat the translation specialists I tested 🔗
r/LocalLLaMA MINISFORUM MS-S1 MAX-P495 🔗
r/LocalLLaMA K2-Horizon-MoVA-36B-A4B-MLX-4bit: up to 49.1 tok/s for local inference — llm-bench.io 🔗
r/LocalLLaMA NVIDIA's $12,930,300,000.00 acquisition of Hugging Face contains an easter egg. The first 6 numbers of the acquisition price represent the decimal conversion of Unicode character U+1F917. The 🤗 emoji. 🔗
r/LocalLLaMA HF easter egg 🔗
r/LocalLLaMA We open-sourced Paddock, our Rust/C++ inference engine with its own CUDA kernels (MIT/Apache-2.0) 🔗
r/LocalLLaMA On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype 🔗
r/LocalLLaMA Has anyone already tried IFM's new K2-Horizon-MoVA-36B-A4B? 🔗
r/LocalLLaMA Spark-2.5-4B is an interesting model for 8GB Jetson Orin Nano Super SoC. 🔗
03.09.2026
r/LocalLLaMA Can the bubble pop please? 🔗
r/LocalLLaMA The benchmarks the big labs don't want you to see 🔗
r/LocalLLaMA I released sanoTTS: smallest complete TTS stack in 294k params (337 KB) that runs on $3 microcontroller and a 1.46m one that beats models 3x and 10x it's size 🔗
r/LocalLLaMA Increasing active parameters per token in MOE (Qwen 35B A4B+) reduce reasoning token by 8.5% - and you don't need to train or finetune! 🔗
r/LocalLLaMA Qwen3.8-27B at ~130 tok/s with full 262k context, on Kaggle's free TPU. OpenAI-compatible endpoint. 🔗
r/LocalLLaMA Need to decide: DGX spark vs framework desktop vs Mac mini/studio 🔗
r/LocalLLaMA Bernie Sanders proposes to ban AI 🔗
r/LocalLLaMA Feature/adaptive kv stream integration by giveen · Pull Request #326 · TheTom/llama-cpp-turboquant 🔗
r/LocalLLaMA Megathread for listing latest open source projects, research papers that are helping optimizations, efficiencies and accessibility to Open Source LLM and related hardware, software ? 🔗
r/LocalLLaMA Qwen3.8-Flash-Next MTP merged in ik_llama.cpp (integrated head or separate -md file)... 45 → 90 tok/s on a 5090 + 128GB, works down to a 12GB 4070 🔗
r/LocalLLaMA "ModelScope" Is a Hugging Face Alternative now that Nvidias deal is a Go 🔗
r/LocalLLaMA Ling-3.0-flash-Fin weights released 🔗
r/LocalLLaMA Apparently ChatGPT, Claude, and Grok were down 🔗