This is so interesting to watch. For a couple minutes I was in awe of how quick and cheap it was. Then I saw just how bad the decision are and how it would get stuck in strange loops of going in and out of the same door to no end.
This seems like a technology heading in the right direction but not quiet there yet. Excited for what they are cooking up but probably won't start building around it yet.
show comments
MitPitt
This is kinda chill to have in the background. I wish there were livestreams showing live reasoning of top models which are currently trying to solve cancer or whatever. Imagine the pogs in chat when it does.
show comments
testaccount28
with such a fat harness, this is more like watching a walk thru play the game.
show comments
rickintoplace
That's actually fun to watch. Did you experiment with nicknaming before you turned it off? I'd be a little curious to see how it behaves.
show comments
djhworld
What's not clear to me on the video is whether jev is doing the button presses for controlling the character to move around.
The "Jev calls" counter only seems to increment at junction points like battles, conversation prompts, menus etc.
Is something else moving the character around?
show comments
lwarfield
Looking at the diagram in the gh repo, it looks like this is entirely jev. Are there any examples of people having a big model like Fable handle high level goals?
show comments
stusmall
>but not fast enough to play Doom yet sadly
Did I miss something? I thought one of the demo videos was it doing pretty decent at the first level of Doom?
show comments
zaik
Seems like it got stuck on a Ghost enemy.
361994752
watched it stuck at rocket hideout for 10 mins.... let me check 1hr later to see if it can find a way out
show comments
dmitrygr
Considering it just made Charizard forget its only fire-type move "Ember" to learn "Counter", I note no signs of intelligence.
show comments
theturtletalks
Is Frigade going to use Jev to do object detection?
show comments
avaer
I wish jev took in images so we could do this generically for any game, without memhacks. I'm sure that's coming.
You could front this with an image -> text model but that would be much lower quality vs latency, and the whole point of doing it with a decision model is remove the latency.
Games are a really interesting testing ground for robotics; if we can solve game playing (incl 3d) we could embody "system one" intelligence into robots that have something emulating general reflexes without needing to fine tune.
This is so interesting to watch. For a couple minutes I was in awe of how quick and cheap it was. Then I saw just how bad the decision are and how it would get stuck in strange loops of going in and out of the same door to no end.
This seems like a technology heading in the right direction but not quiet there yet. Excited for what they are cooking up but probably won't start building around it yet.
This is kinda chill to have in the background. I wish there were livestreams showing live reasoning of top models which are currently trying to solve cancer or whatever. Imagine the pogs in chat when it does.
with such a fat harness, this is more like watching a walk thru play the game.
That's actually fun to watch. Did you experiment with nicknaming before you turned it off? I'd be a little curious to see how it behaves.
What's not clear to me on the video is whether jev is doing the button presses for controlling the character to move around.
The "Jev calls" counter only seems to increment at junction points like battles, conversation prompts, menus etc.
Is something else moving the character around?
Looking at the diagram in the gh repo, it looks like this is entirely jev. Are there any examples of people having a big model like Fable handle high level goals?
>but not fast enough to play Doom yet sadly
Did I miss something? I thought one of the demo videos was it doing pretty decent at the first level of Doom?
Seems like it got stuck on a Ghost enemy.
watched it stuck at rocket hideout for 10 mins.... let me check 1hr later to see if it can find a way out
Considering it just made Charizard forget its only fire-type move "Ember" to learn "Counter", I note no signs of intelligence.
Is Frigade going to use Jev to do object detection?
I wish jev took in images so we could do this generically for any game, without memhacks. I'm sure that's coming.
You could front this with an image -> text model but that would be much lower quality vs latency, and the whole point of doing it with a decision model is remove the latency.
Games are a really interesting testing ground for robotics; if we can solve game playing (incl 3d) we could embody "system one" intelligence into robots that have something emulating general reflexes without needing to fine tune.