LLM models

How to find and host an LLM model on your computer

• Hugging face
• Modelscope

General recipes

• Club 3090 : recipes for 3090/4090/5090 owners.
• MiaAI-Lab : various recipes for popular models.
• Unsloth

Qwen3.8-27B

Running the Qwen3.8-27B model

• ISTA: GSQ-RCO : small quants of ISTA lab.
• MiaAI-Lab for one 16-24 GB GPU using the EXL3 quantization format.
• ninfer-4090 : Qwen3.8-27B on one RTX 4090. Based on ninfer.
• Swift-1.5-Qwen3.8-27b : UkisAI’s reasoning-efficient derivative of Qwen3.8-27B.
• Unsloth Qwen3.8-27b

Qwen3.8-Flash-Next (Q38FN)

Running the Qwen3.8-Flash-Next model

• Unsloth Q38FN
• MiaAI-Lab Q38FN on one DGX Spark using TensorFold.
• Strata Q38FN : run Qwen3.8-Flash-Next from 12GB+ VRAM with smart expert caching.

Gemma4

• Gemma4-31B-QAT
• Gemma4-26B-A4B-QAT

Speech recognition and text-to-speech (TTS)

• VoxCPM

Document processing

• docling
• MinerU

Biology

• evo2