RSS Feed

Day Week Month Year
All r/AI_Agents r/AI_Governance r/ClaudeAI r/ClaudeCode r/DeepSeek r/Futurology r/LangChain r/LocalLLaMA r/MachineLearning r/OpenAI r/artificial r/cybersecurity r/europe r/hermesagent r/netsec r/singularity r/technology

1209 items in r/LocalLLaMA

07.09.2026
r/LocalLLaMA when will open source LLM catch up to Astra I wonder? 🔗
r/LocalLLaMA New Benchmark: The Struggle Bench 🔗
06.09.2026
r/LocalLLaMA Trying to create my own server and consuming it for code with my phone remotely (Mac OS) 🔗
r/LocalLLaMA I built an LLM benchmark harness that lets you browse and compare how models answered each question 🔗
r/LocalLLaMA DeepSeek-V4-Flash-Vision Q8 vs Qwen3.8-Flash-Next Q8 🔗
r/LocalLLaMA Expert expansion with llama.cpp 🔗
r/LocalLLaMA 2x R9700, 64 GB DDR5 is an absolute beast machine with vLLM Radiance / R9V and Qwen 3.8 27b and Flash next 🔗
r/LocalLLaMA Qwen 3.8-27B NVFP4 actually beats Q5_K_M and touches official BF16 levels, but only if you change 2 sampling params. Also almost 3x faster. 🔗
r/LocalLLaMA [Model] Support for Spark2_5ForCausalLM implementation by KnightYao · Pull Request #27868 · ggml-org/llama.cpp 🔗
r/LocalLLaMA Using GPT Astra to teach Qwen Next how to sculpt in 3D in Blender. 🔗
r/LocalLLaMA 8 uncensored Qwen 3.8 27B variants, one base, 167 GPU hours - Abliterlitics 🔗
r/LocalLLaMA Coding benchmarks that are quickly showcasing deep capability 🔗
r/LocalLLaMA vibeblending locally with Qwen 3.8 27B 🔗
r/LocalLLaMA Validate your local LLM advertised KV cache against real pressure; see exactly how old contexts get evicted from cache 🔗
r/LocalLLaMA Villager Simulation Game POC Created with Qwen3.8-27B-UD-Q3_K_XL.gguf - 16GB VRAM 🔗
r/LocalLLaMA Qwen3.8-Flash-Next-oQ4e-mtp: 45 tok/s on M4 Max, 25 tok/s on M2 Ultra for local inference — llm-bench.io 🔗
r/LocalLLaMA Block KV cache streaming: bound VRAM at long context via a shared CUDA phase arena by giveen · Pull Request #357 · TheTom/llama-cpp-turboquant 🔗
r/LocalLLaMA Qwen3.8-27B "Unhacked" my PC 🔗
r/LocalLLaMA Qwen 3.8 Flash Next (Max) is impressive just to talk with. 🔗
05.09.2026
r/LocalLLaMA Which agent harness do you use and why? 🔗
r/LocalLLaMA Your opinion on Ling 3.0 tiny on CPU? 🔗
r/LocalLLaMA Otaku — an LLM frontend 🔗
r/LocalLLaMA Qwen3.8 Flash Next - Templates Comparison 🔗
r/LocalLLaMA The gap has closed, open source will win 🔗
r/LocalLLaMA NInfer vs llama.cpp vs vLLM: quality + speed comparison for Qwen3.8-27B NVFP4 on RTX 5090 🔗