This quick tutorial describes how to create a morphing animation out of an existing video, using StableDiffusion Automatic1111, Deforum Videoinput and ControlNet. Deforum doesn't feature prompt interpolation from a video input out of the box, but with a little bit of math it can be easily achieved. If you have any questions, don't hesitate asking!
I will also use this method for a new musicvideo, which will be published on Friday, March 31 2023, so also visit our musicchannel on Youtube:
/ @vero
Chapters:
00:00 Introduction
00:35 Downloading a free video from Pixabay, that we will use as a basis
01:10 Short overview of the Standard functions in Automatic1111 for video creation
02:03 Explaining the Deforum Interpolation and Videoinput mode
03:22 Developing an interpolation method for Deforum Videoinput
06:23 Adjusting the Deforum settings and rendering the video
07:56 Final Steps
Some useful links:
Local installation guide for Automatic1111 on a WindowsPC:
https://stablediffusionart.com/inst...
and on a Mac with Apple Silicon:
https://stablediffusionart.com/inst...
Deforum Extension download and infos:
https://github.com/deforumart/deforu...
Controlnet Extension download and infos:
https://github.com/Mikubill/sdwebui...
Link to Pixabay for free high quality images:
https://pixabay.com/
ffmpeg, a powerful open source commandline tool for manipulating images and videos:
https://ffmpeg.org/download.html
docs: https://ffmpeg.org/ffmpeg.html
Some great Youtube channels, covering Stable Diffusion:
/ @oliviosarikas
/ @nerdyrodent
/ @sebastiankamph
/ @promptmuse
#stablediffusion #automatic1111 #deforum #tutorial #ffmpeg