BorgDrone@lemmy.onetoSelfhosted@lemmy.world•Using Mac M2 Ultra 192GB to Self-Host LLMs?English
0·
22 days agoyou’d definitely be able to do it cheaper with PC hardware.
You can get a GPU with 192GB VRAM for less than a Mac? Sign me up please.
you’d definitely be able to do it cheaper with PC hardware.
You can get a GPU with 192GB VRAM for less than a Mac? Sign me up please.
And what is the memory bandwidth on these APUs?