Physically Controllable Relighting of Photographs

(yaksoy.github.io)

50 points | by summarity 5 hours ago

4 comments

  • Tepix 3 hours ago

    That's pretty close to magick. Kudos!

    • amelius 3 hours ago

      Neat! And the video was pretty interesting!

      Wait ... patent pending? Research done with public money? Yuck! Downvoted immediately.

      • summarity 48 minutes ago

        This isn’t my work - just sharing the approach. I agree this should have been an open and reproducible publication. It won’t be long for this to become a normal feature in neural rendering engines though, there’s (IMO) no breakthrough novel idea in this pipeline.

      • vonneumannstan 1 hour ago

        Am I mistaken in thinking this was already doable with diffusion models?

        • summarity 49 minutes ago

          Not with any amount of temporal cohesion. This is using neural rendering that can stay consistent across arbitrary lights and their movement. But the authors chose to go proprietary, hopefully we’ll get some open alternatives in the near future.

        • echelon 3 hours ago

          > patent pending

          Ugh, more reason to want AI to automate research. No more patents.

          This is going to be used to shake down teams that had no idea these folks happened to do this off in their own corner of the world.

          • mikeaskew4 3 hours ago

            Could you expand on that?

            • echelon 2 hours ago

              I would like to implement this feature in software.

              Now I cannot legally do so. Not even in free software.

              We have to wait 20 years for this shit to expire. And by that point half of the people here will be retired and technology will have moved on, but this one important technique and feature will still be locked away.

              See also: gif, mp3, h.264/5, seam carving, the ribbon, etc.

              • ragebol 31 minutes ago

                Or outside imagery: 3D printing, only took off after the patents expired. Which is now a huge industry. What could have been would that patent or with it expiring earlier?

                • nomel 1 hour ago

                  Isn't the alternative that everything stays secret/proprietary, forever?