Two different tricks for fast LLM inference
via seangoedecke.com
Short excerpt below. Read at the original source.
Article URL: https://www.seangoedecke.com/fast-llm-inference/ Comments URL: https://news.ycombinator.com/item?id=47022329 Points: 12 # Comments: 3