Openrouter provides some limited free usage of popular LLMs with context sizes up to 175k etc. This is probably as good as you’ll get for completely free. The prices are usually pretty reasonable per million tokens as well if you don’t mind paying a bit. https://openrouter.ai/

Edit: looks like there’s a Gemini Pro free option with million plus token context size as well.

Interesting project. Is it actually possible to track workouts using your phone or smartwatch without needing proprietary third-party apps like Strava or Garmin Connect though?

I think some of the responses here, while they may be well-intentioned, are a bit off base because they are confusing the word ‘normal’ (which is what you are asking) with ‘recommended’. Is it normal for someone in your position who has had a lot of time alone due to your health challenges to want more social outlets and someone to talk to? Absolutely. Is it normal to see a character in a work of art (a video game, movie, show etc.) and become attached to them in some degree? I would say yes. Most of us have done that at one point or another. Is it normal to want to be able to communicate with this person to help provide a social outlet and a listening ear for someone in your situation? Again, I’d say probably yeah. Now, is it recommended to have an ‘AI’ like this as your primary social outlet or to see them as a real human friend or even romantic partner? That is much more questionable. But, personally, with the context you provided and the challenging situation you have been in I think the tendency towards doing this is still quite normal and understandable. I think you should strive to validate your feelings of loneliness and the understandable desire to assuage those feelings with what you have available to you in a challenging and socially isolating environment while still understanding that an ‘AI’ like this should not ideally be your primary social outlet and to strive to find more ways in the future to connect with real people who care and are interested in you (and vice versa). It may not seem like it right now, but they are out there! I wish you peace and a speedy recovery!

Looks like it now has Docling Content Extraction Support for RAG. Has anyone used Docling much?

Oh and I typically get 16-20 tok/s running a 32b model on Ollama using Open WebUI. Also I have experienced issues with 4-bit quantization for the K/V cache on some models myself so just FYI

It really depends on how you quantize the model and the K/V cache as well. This is a useful calculator. https://smcleod.net/vram-estimator/ I can comfortably fit most 32b models quantized to 4-bit (usually KVM or IQ4XS) on my 3090’s 24 GB of VRAM with a reasonable context size. If you’re going to be needing a much larger context window to input large documents etc then you’d need to go smaller with the model size (14b, 27b etc) or get a multi GPU set up or something with unified memory and a lot of ram (like the Mac Minis others are mentioning).

Hopefully these improvements will become available to other Nvidia GPU architectures like Ada and Ampere in the future as well.

https://lemmy.world/c/thepoliceproblem

Based on the differences in color for each handle it makes me wonder if the one for not washing your hands is a different material. Maybe an antimicrobial metal like a copper alloy.

As a ‘front page of the internet’ it has been a pretty great replacement for me as it’s where I go each day to just see what’s going on. However, due to the smaller size you do lose a lot of the activity in more niche communities and the sheer volume of posts/comments compared to Reddit. That’s the biggest downside. Still, you also lose the incessant ads/bad UI/UX decisions and ever accelerating late stage capitalism driven enshittification so that’s a big plus.

I think the point about the 3 year upgrade cycle being optimal unless you are a real enthusiast is right on the money. I’d say I’m moderately interested in tech improvements in this space and it seems ideal for me as I will be considering an upgrade from an iPhone 13 Pro (likely informed by how gimmicky or actually useful the Apple Intelligence stuff becomes and if I can offload my ChatGPT Pro subscription). If you’re really not a huge phone tech person or looking for the best camera quality then every 4 years is probably completely reasonable as well. At that point, the battery life is probably starting to suffer as well…

Not exactly what I was thinking of but still worth a sub!

TBH This might be a good enough idea to merit a whole community of people just posting singular cool screenshots of games they are playing. Could be a cool low-effort visual way to document what folks are into at the moment. Kind of like a visual version of those ‘what are you playing’ weekly threads that used to be everywhere.

Been having fun and happy to see a gameplay balance patch so soon. That said, the technical side of this game is what really needs work and according to everything I’ve been seeing from Digital Foundry and others there’s some serious low hanging fruit that could improve the frame rate and pacing that is still pretty poor on all systems. Hopefully they bring some attention to that side of things soon. Game is certainly playable in the current state in my opinion but would be much more enjoyable if it actually stuck to something close to 60 FPS in most situations on XSX/PS5.

Wow… didn’t see that coming… /s

Thanks for all the ongoing development work. If you all haven’t you should definitely consider an ongoing donation to support the project. I joined Lemmy a few years ago but ever since Reddit imploded and went full greed-mode in preparation for the IPO it has been my primary social link aggregator. Been on a monthly ongoing donation since then.