Isn't part of the Jev marketing that it has "terra-class intelligence"? I don't know how much it actually achieves that, but unless that's EXTREMELY wrong, it's hard to see how a 0.3B model could claim to be an OS Jev.
show comments
speedping
So cool. I've fired up pumas (energy monitor) and it seems to run almost fully on the neural engine and not the GPU so it plays really nicely with CoreML
imranq
Based on my admittedly limited research, it seems like you should use Laya for much more deterministic tasks where you have some training data. It won't be as good as Jev for zero shot cases.
show comments
PaulRobinson
Local LLMs are the future, and one of the reasons I think the data centre furore is just going to end in a market crash.
LLMs that can reliably be used for control problems are the future, and I think classic/deep RL has generally been overlooked for years for a whole host of problems by wider industry because it felt inaccessible. The first thing I thought of when I saw Jev (and then Laya), was "this might move the needle in a really, really interesting way".
Local LLMs that can reliably be used for control problems smash through a lot of barriers I'm interested in, and this intrigues me a lot. Guess I'm about to become a big Laya fan if it can run on this kind of hardware to this performance.
show comments
altano
How much memory does this use of the test machine's (M3 Max) 128 GB unified memory?
show comments
frag
Great job!
Did you finetune your own Laya for the snake game or what?
show comments
tentacleuno
This looks like a local AI model playing Snake -- is that correct? The article offers no explanation.
Isn't part of the Jev marketing that it has "terra-class intelligence"? I don't know how much it actually achieves that, but unless that's EXTREMELY wrong, it's hard to see how a 0.3B model could claim to be an OS Jev.
So cool. I've fired up pumas (energy monitor) and it seems to run almost fully on the neural engine and not the GPU so it plays really nicely with CoreML
Based on my admittedly limited research, it seems like you should use Laya for much more deterministic tasks where you have some training data. It won't be as good as Jev for zero shot cases.
Local LLMs are the future, and one of the reasons I think the data centre furore is just going to end in a market crash.
LLMs that can reliably be used for control problems are the future, and I think classic/deep RL has generally been overlooked for years for a whole host of problems by wider industry because it felt inaccessible. The first thing I thought of when I saw Jev (and then Laya), was "this might move the needle in a really, really interesting way".
Local LLMs that can reliably be used for control problems smash through a lot of barriers I'm interested in, and this intrigues me a lot. Guess I'm about to become a big Laya fan if it can run on this kind of hardware to this performance.
How much memory does this use of the test machine's (M3 Max) 128 GB unified memory?
Great job! Did you finetune your own Laya for the snake game or what?
This looks like a local AI model playing Snake -- is that correct? The article offers no explanation.