The Picard Maneuver@piefed.world to Lemmy Shitpost@lemmy.worldEnglish · 24 hours agoSeems legitmedia.piefed.worldimagemessage-square44linkfedilinkarrow-up1504arrow-down17
arrow-up1497arrow-down1imageSeems legitmedia.piefed.worldThe Picard Maneuver@piefed.world to Lemmy Shitpost@lemmy.worldEnglish · 24 hours agomessage-square44linkfedilink
minus-squareUriel238 [all pronouns]@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up7arrow-down1·15 hours agoOffline LLMs exist but tend to have a few terabytes of base data just to get started (e.g. before LORAs)
minus-squarenomorebillboards@lemmy.worldlinkfedilinkarrow-up8·10 hours agoI thought it was more like 10-20GB to start out with a usable (but somewhat stupid) model. Are you confusing the size of the dataset with the size of the model?
Offline LLMs exist but tend to have a few terabytes of base data just to get started (e.g. before LORAs)
I thought it was more like 10-20GB to start out with a usable (but somewhat stupid) model.
Are you confusing the size of the dataset with the size of the model?