jaykrown@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comexternal-linkmessage-square122linkfedilinkarrow-up1401arrow-down17
arrow-up1394arrow-down1external-linkDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comjaykrown@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square122linkfedilink
minus-squareaksdb@lemmy.worldlinkfedilinkEnglisharrow-up12·edit-21 day agoLLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use. But you are right that more and slightly slower is still better than less but fast.
LLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use.
But you are right that more and slightly slower is still better than less but fast.