Show HN: sllm – Split a GPU node with other developers, unlimited tokens
via news.ycombinator.com
Short excerpt below. Read at the original source.
Running DeepSeek V3 (685B) requires 8×H100 GPUs which is about $14k/month. Most developers only need 15-25 tok/s. sllm lets you join a cohort of developers sharing a dedicated node. You reserve a spot with your card, and nobody is charged until the cohort fills. Prices start at $5/mo for smaller models. The LLMs are completely […]