Better Gaussian Splatting in Julia

(pxl-th.github.io)

90 points | by pxl-th 4 days ago

9 comments

  • Cieric 22 minutes ago

    I'm still very fascinated by gaussian splatting, but the issue I always run into is the need to use colmap to generate the camera positions and get the initial point cloud. Which colmap effectively still needs Nvidia for dense point clouds last I checked. I'm curious though does anyone have anything else they've tried that worked well? I've tried a few different things (most of the time getting stuck on just compiling the thing) so I'm curious if anyone has any suggestions that I should focus more heavily on getting working. I have some poor quality videos I'd like to try and use and I'm willing to put in some manual work, but it feels like it's all automatic or nothing. Thanks for any suggestions that any of you have.

    • hdz 4 hours ago

      Having this work on Apple metal is huge for the accessibility around training splats. I remember two years ago I needed an RTX Nvidia GPU to run things like splatfacto on nerfstudio. Very neat optimizations as well like the depth map and sky dome, 3dgs has come a long way. Awesome!

      • mourner 4 hours ago

        Oh, a fellow Ukrainian! Was pleasantly surprised to see that fountain on HN — I was just walking around it a few days ago, very nice and peaceful spot this time of year.

        • xchip 10 minutes ago

          Hey Anton, great work as always :)

          • miguelraz 1 hour ago

            Fantastic demos in Julia, what a treat.

            • fredley 4 hours ago

              I thought the picture on your home page was very cool, and then I moused over it. Absolutely incredible.

              • chrisjj 3 hours ago

                Better? A turn on the spot shows a wreck everywhere but forward.

                • yorwba 1 hour ago

                  Those are the areas that are occluded in the input images. If you look at the bushes, you can see that the front is clean while the back is a mess. Probably the starting position could be chosen a bit better.

                  • chrisjj 30 minutes ago

                    The path to left and right is occluded? By what?

                  • pwf 1 hour ago

                    do you know how gaussian splatting works?

                  • thimotedupuch 4 hours ago

                    Great work

                    • aithena 5 hours ago

                      this is amazing!