Cool concept, will try it out! I've had decent results with computer use operating conventional editing tools, but being able to directly edit JSON project files is a solid optimization and opens up a lot of opportunities with things like modular templating.
This is pretty dang cool but I guess I was hoping to see some very clever use of vision and maybe waveform analysis to give the model "eyes and ears" to edit audio and video. V2
I have no use for this, however I am stunned by the simple and effective solution of using json+sse instead of an API to allow agent interaction
Amazing work
I couldn't find a skill in your project that would help integrate mediabunny. The docs and examples look like they could really help. Having good example coverage allows agents to pickup libraries easily.
This looks great, will try it out. I had a crazy idea of doing a full agentic demo video narration and cutting, so might try your tool with some tweaks.
Thanks! That sounds like a really interesting use case. I'd love to see how it turns out. If you end up making those tweaks for full agentic narration and video cutting, feel free to share your experience or ideas, I'd be happy to learn from them and see if they could be incorporated into the tool.
I have little experience with video editing; a tool like this might be an ideal path to learn more. Thanks for creating and publishing it and sharing here!
almost! the editor/compositor is fully browser side, but the server is doing real work: project.json lives on disk (thats the whole point, any agent or script can edit it and fs.watch + sse hot reloads the ui), plus ffmpeg for the final export encode. so it needs the local server for the actual workflow.
a hosted demo mode is a good idea though, project in localstorage + sample footage + mediarecorder export would let people feel the editor without cloning. the one thing it cant show is the main trick, watching an external agent rebuild your timeline live, since theres no local file for it to edit. might do a stripped demo build if theres interest
Since people like an unrelated product, you thought it would be good marketing to jack the brand? Maybe I should start calling my B2B SaaS products Salesforce too!
Sure, but we can't handwave away every observation about LLM output with "(some of) the original training corpora came from humans". Qualitatively, the vibes are off™.
PSA stop putting bigco IP in your project names!
has clawdbot taught us nothing?
Guess it is efficient for attention.
is "Notepad" a bigco IP project name?
yes, microsoft does hold a trademark for notepad. As litigious as MS is I'm pleasantly surprised they've left notepad++ alone.
Unfortunately anthropic is actively eroding community goodwill in regards to potential IP conflicts:
https://abnormal.ai/blog/abnormal-response-to-anthropic-laws...
https://x.com/steipete/status/2016068265391354181
Microsoft has a lot of trademark meant to protect them from agression rather than attack themselves
Cool concept, will try it out! I've had decent results with computer use operating conventional editing tools, but being able to directly edit JSON project files is a solid optimization and opens up a lot of opportunities with things like modular templating.
Thankyou. I am planning to make it opencode friendly too.. I think that would openup versatality and more experiments..;)
Reminds me of https://www.screenkite.com/ The AI powered video editors are fun.
yup but I had Premier Pro and Palmier Pro in mind while making it, hence the UI.;)
This is pretty dang cool but I guess I was hoping to see some very clever use of vision and maybe waveform analysis to give the model "eyes and ears" to edit audio and video. V2
noted.
Yeah I'm sure you need fable for the heavy reasoning task of editing tiktoks
My impression was that they made this editor with Fable, and its JSON project structure would only serve well for manipulation by lesser models.
cool!
can this be used to make these style of videos from prompt?
Style 1: https://www.youtube.com/shorts/vGjrv2zjfsM
Style 2: https://www.youtube.com/shorts/6KoRHpAZ4zk
Absolutely, in fact just give it clips, voice and a reference video(optional), command it and wait untill it finishes..
I have no use for this, however I am stunned by the simple and effective solution of using json+sse instead of an API to allow agent interaction Amazing work
What's the benefit of SSEs here?
That was the goal. Thankyou btw.
You should strongly consider using Mediabunny to do all of the rendering client-side!
I couldn't find a skill in your project that would help integrate mediabunny. The docs and examples look like they could really help. Having good example coverage allows agents to pickup libraries easily.
https://github.com/Vanilagy/mediabunny
Just point the agent at the docs, it'll understand them quickly. Mediabunny also has many examples and even a dedicated LLM page.
This looks great, will try it out. I had a crazy idea of doing a full agentic demo video narration and cutting, so might try your tool with some tweaks.
Thanks! That sounds like a really interesting use case. I'd love to see how it turns out. If you end up making those tweaks for full agentic narration and video cutting, feel free to share your experience or ideas, I'd be happy to learn from them and see if they could be incorporated into the tool.
you can just give claude code access to ffmpeg
A demo video would be good.
Yeah actually, that's a great idea, working on it ..(～￣▽￣)～
Have you thought about integrating Remotion into this?
What do you think the next update will be about..^_~
Just watch out for their license...
Love that the timeline is just JSON and the UI hot-reloads. Agents and humans on the same edit is the interesting part.
I have little experience with video editing; a tool like this might be an ideal path to learn more. Thanks for creating and publishing it and sharing here!
My pleasure. If you have any ideas, lets connect and make it more helpfuul!!
You aren't going to learn by having the AI do it for you...
Facts!!!
You should have a hosted site for this - It is entirely frontend - right?
almost! the editor/compositor is fully browser side, but the server is doing real work: project.json lives on disk (thats the whole point, any agent or script can edit it and fs.watch + sse hot reloads the ui), plus ffmpeg for the final export encode. so it needs the local server for the actual workflow.
a hosted demo mode is a good idea though, project in localstorage + sample footage + mediarecorder export would let people feel the editor without cloning. the one thing it cant show is the main trick, watching an external agent rebuild your timeline live, since theres no local file for it to edit. might do a stripped demo build if theres interest
Ya, a demo video would be nice .
On it sir.
Very cool project but having fable in the name makes it sound so tacky
Yeah I though so but as people are so fond of Fable.. This would give them a poke to just take a look..;)
oh, I read fable as a story, fable cut meaning you can stitch up stories which is a form of storytelling, so quite fitting for video editor
Since people like an unrelated product, you thought it would be good marketing to jack the brand? Maybe I should start calling my B2B SaaS products Salesforce too!
The readme is full of compound Claudeisms, so why not ;-)
That’s just how some humans write. These words didn’t come from an LLM vacuum.
>That’s just how some humans write.
Sure, but we can't handwave away every observation about LLM output with "(some of) the original training corpora came from humans". Qualitatively, the vibes are off™.
https://old.reddit.com/r/ClaudeAI/comments/1uok58g/claudes_s...
https://x.com/emollick/status/2049894109318459798
Remember the gremlin thing?
https://news.ycombinator.com/item?id=47319285
it also worked
happy to know, thanks!!..;)