Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe

[tatef]

Article URL: https://github.com/t8/hypura

Comments URL: https://news.ycombinator.com/item?id=47504695

Points: 81

# Comments: 42