Settings

Theme

Show HN: ComfyUI extension for the new Stable Video Diffusion model

github.com

3 points by subtech 2 years ago · 6 comments · 1 min read

Reader

Hey HN!

Just shipped a new ComfyUI extension to add support for the new Stable Video Diffusion model!

Now, you can plug this into any existing ComfyUI workflow to do some really cool things!

Here are a few examples:

Image to video workflow: https://comfyworkflows.com/workflows/5a4cd9fd-9685-4985-adb8...

Image to video workflow (w/ high FPS using RIFE frame interpolation): https://comfyworkflows.com/workflows/bf3b455d-ba13-4063-9ab7...

Would love to hear any feedback! :)

Kevin09210 2 years ago

Well, I can't load the workflow. Installing the missing nodes requires restarting comfyui and it seems persistence on comfyworkflow's cloud isn't guaranteed anymore.

Also this website is pure single-page garbage. Everything is super slow, can't ctrl+click on a link to open it in another tab, etc ... An UX nightmare.

Can you recommend a competitor ? Looking at:

- https://www.thinkdiffusion.com/

- https://rundiffusion.com/comfyui-workflows

- https://flowt.ai/

tinytera 2 years ago

This is great! I use ComfyUI extensively and will try this out. Its hard to setup workflow correctly for these Video diffusion models.

I recently built a set of docker images to simplify GenAI workflows. Check it out at https://github.com/jaideep2/apinaio

Only works on CUDA hardware for now, but contributions welcome :)

gus_massa 2 years ago

In the first example https://comfyworkflows.com/workflows/5a4cd9fd-9685-4985-adb8... Which are the initial images? How many? Only two or a few?

  • subtechOP 2 years ago

    The initial image is just 1 -- the very first frame of the video.

    • gus_massa 2 years ago

      I don't understand how you tell the rocket is going up and the floor is not moving. Is that in the workflow [1] or the program firere that without help.

      [1] I don't understand what the worflow says. Sorry if my question is obvious.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection