adishj
Joined 6 years ago
Joined 6 years ago
That being said, the coolest part with this Rough Cut was that it decided to stand in the footage of the kite to creatively imply the freefall portion of the skydive (because we aren't able to record while we're jumping out of a plane). This ability for it to creatively decided to imply the jump because of the limited footage is what I wanted to get across here.
We also do transcoding of all uploaded files to lower-res proxies, which can be re-linked when brought back into a more traditional NLE.
for example, if you have a workflow setup to create 5 clips from a podcast and add b-rolls and captions and reframe to a few different aspect ratios, any time you invoke this workflow (regardless of which podcast episode you're providing as input), you'll get 5 clips back that have b-rolls, captions, and are reframed to a few different aspect ratios
however, which clips are selected, what b-rolls are generated, where they're placed — this is all non-deterministic
you can guide the agent via prompting the tiles individually, but that's still just an input into a non-deterministic machine
same with returning that back to the user as manipulated output (text / code generation is much more rapid than rendering a video)
Video is hard, but it's also a fun modality which presents some interesting challenges. And is where content is converging towards.