A quick update on the 120B model running across 6 devices — my Android phone dropped offline overnight, and the cluster automatically redistributed its shard to another device with zero downtime. Still up, still answering questions, no errors.
RAMDeck — Pool Your RAM. Run Bigger AI.
Run and train models too big for any single machine, using the PCs, Macs, mini PCs and phones you already own.
Learn more at ramdeck.com
Leave a Reply