From my understanding a lot of books are still getting digitized, so there is a constant trickle of old literature and news papers and such. But really the answer is synthetic data. Data made by AI and other means for the purpose of training. Which that is very different than just insta slop.
Hi
- 2 Posts
- 193 Comments
I’ve never read the Wikipedia for it! Thanks for linking to it!
PS: Finchley Central seems like such a goofy game. I’m very inspired by it.
The days of just scraping the internet are over. Data quality is a huge part of LLM training, I don’t think insta getting sloppified will save us unfortunately.
pebbles@sh.itjust.worksto
Lemmy Shitpost@lemmy.world•I'm on Lemmy to commiepost and chew bubblegum. And I'm all out of gum.English
1·1 day agoSame here, I’ve mainly heard the presense of the state as the discriminator between anarchism and communism.
This comic made me lose the game
I hope this is some sort of Chris Hansen operation.
If not, OP I’d reccomend you take screenshots of any text/DMs you have with folks that reach out in case you want to prosecute them later.
pebbles@sh.itjust.worksto
Lemmy Shitpost@lemmy.world•i cut myself in th school bathroom cause im a depressed girlfailiureEnglish
6·10 days agoI hope this is some sort of Chris Hansen operation.
If not, OP I’d reccomend you take screenshots of any text/DMs you have with folks that reach out in case you want to prosecute them later.
pebbles@sh.itjust.worksto
Technology@lemmy.ml•Qualcomm readies phones for Wi-Fi 8, Bluetooth 7, and faster 5G eraEnglish
5·12 days agoAre we getting better at packing bits into the same bandwidth or just increasing bandwidth?
Hey, gals who sleep around don’t deserve to be associated with Erica Kirk. Also, slop is lame.
pebbles@sh.itjust.worksto
Lemmy Shitpost@lemmy.world•This guy already voted, did you ?English
111·15 days agoDoes this man listen to the clown music??
Super fun! Scrambled together a pretty solid Guy Feiri costume in the morning, volunteered at mutual aid org I like a lot, then went out dancing with some friends from that org.
Anyone got tips for no shit November this year?
pebbles@sh.itjust.worksto
Lemmy Shitpost@lemmy.world•Buddha orders a pizza: "Make me One with Everything"English
5·27 days agoIt’s also Chan Zen.
pebbles@sh.itjust.worksto
Lemmy Shitpost@lemmy.world•Buddha orders a pizza: "Make me One with Everything"English
30·27 days agoI know it is a shitpost but I think the goal is sometimes to force a student to move away from thought.
pebbles@sh.itjust.worksto
Asklemmy@lemmy.ml•What really happened in real life that if you saw it in a movie you would say "that's totally unrealistic"?English
17·1 month agoI really want to take the rage bait.
I’ve been on a Burnout Paradise replay and it’s just such a good game.
pebbles@sh.itjust.worksto
Asklemmy@lemmy.ml•Which are some low effort habits or hobbies that have had a positive impact on your life?English
4·1 month agoSet the phone in another room.
deleted by creator
pebbles@sh.itjust.worksto
Lemmy Shitpost@lemmy.world•You should have stayed home.English
10·2 months agoNo no, one must only ponder objects and things.



I would reccomend you look into sythetic data. It is a real thing and is used intentionally in basically every LLM of the past year or more. Last I heard of an LLM without sythetic data was Dots LLM1 and that wasn’t competitive when it came out.