Super impressive looking demo, works well on my older iphone.
As an only-dabbling-hobbiest game developer who lacks a lot of 3d programming knowledge, the only feedback I can offer is you might perhaps define what "Gaussian Splatting" is somewhere on the github or the website. Just the one-liner from wikipedia helps me get more excited about the project and potential uses: Gaussian splatting is a volume rendering technique that deals with the direct rendering of volume data without converting the data into surface or line primitives.
Super high performance clouds and fire and smoke and such? Awesome!
show comments
jasonthorsness
The food scans demo ("Interactivity" examples section) is incredible. Especially Mel's Steak Sandwich looking into the holes in the bread.
The performance seems amazingly good for the apparent level of detail, even on my integrated graphics laptop. Where is this technique most commonly used today?
Cool work, but I have to say the performance is pretty bad in Firefox on my laptop with an Nvidia RTX A3000 GPU. There are enough shader cores here to cause first degree burns.
show comments
VikingCoder
Can I run around with my phone, and capture some Gaussian Splats of... grass... bushes... dirt...
And then select one-meter square patches of land... and one-meter cubes of spots with bushes...
And then make a "Minecraft-looking" world, repeating the grass block all over the place, with occasional dirt and bushes?
I'm guessing I'd need some pretty beefy hardware to render thousands of blocks...
show comments
fidotron
Very very cool.
Do you have any insights into the current performance bottlenecks? Especially around dynamic scenes. That particle simulation one seems to struggle but then improves dramatically when the camera is rotated, implying the static background is much heavier than it appears.
And as a counterpoint to the bottlenecks, that Sierpinski pyramid, procedurally, is brilliant.
I'm still highly skeptical of gaussian splatting as anything more than a demo. The files are too large. The steak sandwich is 12meg (as just one example)
There was a guassain splat based Matterport port clone at least year's siggraph. To view a 2 bedroom apartment required streaming 1.5gig
Cool demo
show comments
Epa095
Slightly overloaded name. There is already Apache Spark, SPARK (Ada), sparklines, and SPARQL.
show comments
bryzaguy
Wish I could see this! My iPhone 16 blocked viewing because of, I think, expired certificate. At least, that’s the error I think I got initially and now it just says the page belongs to a category that is blocked. :(
show comments
mbo
Amazing stuff!
Do you foresee this project getting a Web Components API like A-Frame and Google's <model-viewer> component (https://modelviewer.dev/)?
show comments
imachine1980_
What's the difference in this and and .obj render? Does gaussian produce a different format?
show comments
two_handfuls
This looks super cool! Would this work in VR if someone opens the web page from a web browser? Because that would be even more awesome!
show comments
danybittel
How do you do the rendering? Is it sorted (radix?) instances? Do you amortize the sorting over a couple frames? Or use some bin sorting? Are you happy with the performance?
show comments
_tqr3
This is great, thanks!
I have spent countless hours playing with the R3F - adding vertex and fragment shaders, eventually giving up. The math is just tedious.
show comments
markisus
The demos look great! I imagine it's not pure javascript. Are you using webgpu?
show comments
ge96
That steak made my mouth water, mission accomplished
praveen9920
Any plans to extend support for triangle splats?
show comments
feiss
Super cool! Congrats on the launch :))
cchance
any chance this will support the video style 3d gaussian splats?
show comments
vmesel
hey @dmarcos! Congrats on the launch!
from your fellow gh accelerator friend, vinnie!
moron4hire
That interactive demo on the front page running perfectly fine on my Pixel 7 was pretty sick!
90s_dev
We seem to have to poles: extreme realism, and extremely minimalistic pixel art. I prefer the second camp. But your project looks really important in the first camp.
show comments
akomtu
Cool stuff. Do you have examples with semi-transparent surfaces? Something like a toy christmas tree inside a glass sphere, with basic reflections and refractions calculated?
Wait, you renamed Forge (https://forge.dev) released last week by World Labs, a startup that raised $230M.
Is this "I worked with some friends and I hope you find useful" or is it "So proud of the World Labs team that made this happen, and we are making this open source for everyone" (CEO, World Labs)?
Super impressive looking demo, works well on my older iphone.
As an only-dabbling-hobbiest game developer who lacks a lot of 3d programming knowledge, the only feedback I can offer is you might perhaps define what "Gaussian Splatting" is somewhere on the github or the website. Just the one-liner from wikipedia helps me get more excited about the project and potential uses: Gaussian splatting is a volume rendering technique that deals with the direct rendering of volume data without converting the data into surface or line primitives.
Super high performance clouds and fire and smoke and such? Awesome!
The food scans demo ("Interactivity" examples section) is incredible. Especially Mel's Steak Sandwich looking into the holes in the bread.
The performance seems amazingly good for the apparent level of detail, even on my integrated graphics laptop. Where is this technique most commonly used today?
This is cool also BabylonJS has nice gaussian splat support as well: https://doc.babylonjs.com/features/featuresDeepDive/mesh/gau...
Cool work, but I have to say the performance is pretty bad in Firefox on my laptop with an Nvidia RTX A3000 GPU. There are enough shader cores here to cause first degree burns.
Can I run around with my phone, and capture some Gaussian Splats of... grass... bushes... dirt...
And then select one-meter square patches of land... and one-meter cubes of spots with bushes...
And then make a "Minecraft-looking" world, repeating the grass block all over the place, with occasional dirt and bushes?
I'm guessing I'd need some pretty beefy hardware to render thousands of blocks...
Very very cool.
Do you have any insights into the current performance bottlenecks? Especially around dynamic scenes. That particle simulation one seems to struggle but then improves dramatically when the camera is rotated, implying the static background is much heavier than it appears.
And as a counterpoint to the bottlenecks, that Sierpinski pyramid, procedurally, is brilliant.
Slightly more obvious repo link https://github.com/sparkjsdev/spark
I'm still highly skeptical of gaussian splatting as anything more than a demo. The files are too large. The steak sandwich is 12meg (as just one example)
There was a guassain splat based Matterport port clone at least year's siggraph. To view a 2 bedroom apartment required streaming 1.5gig
Cool demo
Slightly overloaded name. There is already Apache Spark, SPARK (Ada), sparklines, and SPARQL.
Wish I could see this! My iPhone 16 blocked viewing because of, I think, expired certificate. At least, that’s the error I think I got initially and now it just says the page belongs to a category that is blocked. :(
Amazing stuff!
Do you foresee this project getting a Web Components API like A-Frame and Google's <model-viewer> component (https://modelviewer.dev/)?
What's the difference in this and and .obj render? Does gaussian produce a different format?
This looks super cool! Would this work in VR if someone opens the web page from a web browser? Because that would be even more awesome!
How do you do the rendering? Is it sorted (radix?) instances? Do you amortize the sorting over a couple frames? Or use some bin sorting? Are you happy with the performance?
This is great, thanks!
I have spent countless hours playing with the R3F - adding vertex and fragment shaders, eventually giving up. The math is just tedious.
The demos look great! I imagine it's not pure javascript. Are you using webgpu?
That steak made my mouth water, mission accomplished
Any plans to extend support for triangle splats?
Super cool! Congrats on the launch :))
any chance this will support the video style 3d gaussian splats?
hey @dmarcos! Congrats on the launch!
from your fellow gh accelerator friend, vinnie!
That interactive demo on the front page running perfectly fine on my Pixel 7 was pretty sick!
We seem to have to poles: extreme realism, and extremely minimalistic pixel art. I prefer the second camp. But your project looks really important in the first camp.
Cool stuff. Do you have examples with semi-transparent surfaces? Something like a toy christmas tree inside a glass sphere, with basic reflections and refractions calculated?
PartCAD can export CAD models to Three.js.
The OCP CAD viewer extension for build123d and cadquery models, for example, is also built on Three.js. https://github.com/bernhard-42/vscode-ocp-cad-viewer
Wait, you renamed Forge (https://forge.dev) released last week by World Labs, a startup that raised $230M.
Is this "I worked with some friends and I hope you find useful" or is it "So proud of the World Labs team that made this happen, and we are making this open source for everyone" (CEO, World Labs)?
https://x.com/drfeifei/status/1929617676810572234