A 35B MoE on a 16 GB GPU, without the offload tax

 (lucebox.com)

14 points | by GreenGames 2 days ago

1 comments