Pallaidium - genAI in the Video Sequence Editor

Finally acually used this addon for the music in this video!

1 Like

Zeroscope is a new text2video model added to the Generative AI add-on:


1 Like

The Generative AI add-on now enables access to the new Potat1 model trained on 1024x576.
Video by Iskarioto:

This addon looks amazing but I’m failing at the first,

ModuleNotFoundError: No module named ‘torch’

and then 2nd hurdle, trying to use the blender_pip addon to install gives me the following error:

Traceback (most recent call last):
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\runpy.py”, line 196, in _run_module_as_main
return run_code(code, main_globals, None,
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\runpy.py”, line 86, in run_code
exec(code, run_globals)
File "myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_main
.py", line 31, in
sys.exit(main())
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\cli\main.py”, line 77, in main
command = create_command(cmd_name, isolated=(“–isolated” in cmd_args))
File "myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\commands_init
.py", line 114, in create_command
module = importlib.import_module(module_path)
File "myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\importlib_init
.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File “”, line 1050, in _gcd_import
File “”, line 1027, in _find_and_load
File “”, line 1006, in _find_and_load_unlocked
File “”, line 688, in _load_unlocked
File “”, line 883, in exec_module
File “”, line 241, in _call_with_frames_removed
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\commands\install.py”, line 15, in
from pip._internal.cli.req_command import (
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\cli\req_command.py”, line 21, in
from pip._internal.index.package_finder import PackageFinder
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\index\package_finder.py”, line 30, in
from pip.internal.req import InstallRequirement
File "myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\req_init
.py", line 8, in
from .req_install import InstallRequirement
File “myUserName\Desktop\blender-3.5.1-windows-x64\3.5\python\lib\site-packages\pip_internal\req\req_install.py”, line 20, in
from pip._vendor.pyproject_hooks import BuildBackendHookCaller
ModuleNotFoundError: No module named ‘pip._vendor.pyproject_hooks’

Could you make a report on GitHub instead?
(Looks like you have Blender on your Desktop? You should properly start with installing Blender properly, and follow the installation instructions on GitHub)

Dogme95, but for AI:
https://twitter.com/theculturedao/status/1669752247495065600

You have seen Will Smith eating spaghetti, here’s Gollum eating spaghetti!
(Using a new(yet unreleased) model by camenduru and this add-on)

1 Like

Update:

  • Zeroscope XL upscale step added for smaller Zeroscope models.
  • Stable Diffusion XL added.
2 Likes

Update:

  • SD XL 1.0 added.
2 Likes

A new version of the Generative AI Blender add-on, with img2img and vid2vid is up.

1 Like

img2vid:

What version of blender is this Ai thing compatible with? 3.6 or 4.0?

is there anyway you can integrate ComfyUi with blender? the node system is almost like blender.

1 Like

It’s compatible with both.

img2vid

Image generated with SDXL, video with Zeroscope XL through this add-on:

1 Like

Done in the add-on ^

1 Like

2 Likes

1 Like

In the Blender Generative Add-on you can generate images with Stable Diffusion XL, make them come alive with Zeroscope XL and add music and sounds with AudioLDM2:

1 Like

wow this is impressive, following

1 Like