Is it just me or it’s really underwhelming that they seem to remove a lot of layers and still only get 30 tokens per second? I hope they’re at least more energy efficient.
I think it’ll depend on how much these chips cost. If it’s gonna be something like a Raspberry Pi that works as well as a 500 dollar GPU, that’s gonna be pretty amazing.
Is it just me or it’s really underwhelming that they seem to remove a lot of layers and still only get 30 tokens per second? I hope they’re at least more energy efficient.
I think it’ll depend on how much these chips cost. If it’s gonna be something like a Raspberry Pi that works as well as a 500 dollar GPU, that’s gonna be pretty amazing.
(Cries in $1,300 Intel arc fighting tooth and nail to break 25t/s…)
haha I keep forgetting how insane prices are now