I have developed a simple methodology for users to interact with the video sequencer timeline while it is playing.
In short, you can easily define “loopable” sequence strips that wait for the user to “click” with the mouse to break out of the loop and continue playing the timeline.
You can also define clickable “hitbox” regions on the preview screen and “Goto” a specfic timeline marker/frame and continue playing.
I have created a couple of interactive Blender projects that affirm the approach but lack the drawing skill to make it Wow!
I envision a version of Big Buck Bunny that can be interacted with scenes such as clicking on butterflies to get get hit by acorns, traps in the forest…etc
I like the idea that .blend files can contain compressed sounds/movies so that it is a “standalone” similar to the old SWF files from the Flash days. Just open in Blender and play.
Feedback that I have received has been less that positive:
Blender Game Engine in Sequencer, lol. Not gonna happen.
People will make 1 handed games with it
There are already other programs that already do this
People will steal my artwork
The next steps I am working on is creating an Export function that will write the interactive timelime to a HTML5 folder with JavaScript logic embedded. Since SWF support is hanging on (barely) with the Ruffle extension, I haven’t ruled out writing an Export to SWF as well.