Feels like the kind of headline that would briefly pause in front of the camera to establish how the world got "like this".
show comments
rybosome
I have far more ideas about this than time to execute it, but for a long time I’ve had this fantasy about a robot bandmate.
The idea is I’d go on stage singing and playing guitar with a looper and some samples, then bring a robot toy and introduce the robot “controlling” the looping and sampling as the bandmate.
It’s a gimmick that’s been done before, but with LLMs driving verbal interaction and now I could use this to animate a robot…it becomes pretty compelling. I’d plug the LLMs into the audio feed so I could banter with it and get responses then have the robot avatar animate accordingly.
If only my full time job saw value in this project.
show comments
spaceport
Ive been using the ollama nextcloud integration for a while and while rough at times it does work to control many devices. Lights and music. Very nontrivial to get it working consistantly however so maybe this could work. Not going to connect it to cloud claude however.
Also for the author in case they read this, the central/decentral hub architecture writing in privacy section is overly complex. Simplify it as "locally hosted, not cloud connected"
show comments
chrisdalke
Cool! As a moonshot fun idea I’ve been interested in MCP as a way to use informal conversations to task robots. I’ll have to play around with this!
One example on unmanned boats: a human could radio to the boat over VHF and say “move 100 meters south”… that speech-to-text would feed to an LLM which extracts the meaning and calls the MCP.
I’ll have to install this and play around.
show comments
neonwatty
automating some of the boilerplate when dealing with microcontrollers like the esp32 would be great.
also great - improving the ide interface: the last time i worked with esp32's using (micro) python the best solution i found was the Thonny ide - not the most productive setup.
Feels like the kind of headline that would briefly pause in front of the camera to establish how the world got "like this".
I have far more ideas about this than time to execute it, but for a long time I’ve had this fantasy about a robot bandmate.
The idea is I’d go on stage singing and playing guitar with a looper and some samples, then bring a robot toy and introduce the robot “controlling” the looping and sampling as the bandmate.
It’s a gimmick that’s been done before, but with LLMs driving verbal interaction and now I could use this to animate a robot…it becomes pretty compelling. I’d plug the LLMs into the audio feed so I could banter with it and get responses then have the robot avatar animate accordingly.
If only my full time job saw value in this project.
Ive been using the ollama nextcloud integration for a while and while rough at times it does work to control many devices. Lights and music. Very nontrivial to get it working consistantly however so maybe this could work. Not going to connect it to cloud claude however.
Also for the author in case they read this, the central/decentral hub architecture writing in privacy section is overly complex. Simplify it as "locally hosted, not cloud connected"
Cool! As a moonshot fun idea I’ve been interested in MCP as a way to use informal conversations to task robots. I’ll have to play around with this!
One example on unmanned boats: a human could radio to the boat over VHF and say “move 100 meters south”… that speech-to-text would feed to an LLM which extracts the meaning and calls the MCP.
I’ll have to install this and play around.
automating some of the boilerplate when dealing with microcontrollers like the esp32 would be great.
also great - improving the ide interface: the last time i worked with esp32's using (micro) python the best solution i found was the Thonny ide - not the most productive setup.
Isn't Home Assistant already doing this?
It is a weirdly exciting time to be alive.
cue the curb theme song
very neat.
[dead]
"What could go wrong?"
"Open the pod bay doors, HAL"...
[flagged]