>>16515
One example of a controlnet usage is an I2I workflow. I used to think that the vision model in such workflow is just generating tags (maybe a lot of tags) from the source image, but after some reading I realized that it must be providing a controlnet for the diffusion model and that makes the resulting image close to the original, even though in a different style.
Below are a couple of lame videos that I generated using this approach. They look OKish given the really low effort I put into them. I was able to do that because I started from line drawing made by actual artists.