ControlNet: Difference between revisions
StableTiger3 (talk | contribs) (Created page with "ControlNet can best be described by the the very scientists who developed it: "We present a neural network structure, ControlNet, to control pretrained large diffusion models to support additional input conditions. The ControlNet learns task-specific conditions in an end-to-end way, and the learning is robust even when the training dataset is small (< 50k)." https://arxiv.org/abs/2302.05543 In other words, in addition to the word prompts and other numeric parametric inp...") |
StableTiger3 (talk | contribs) mNo edit summary |
||
| Line 3: | Line 3: | ||
https://arxiv.org/abs/2302.05543 | https://arxiv.org/abs/2302.05543 | ||
In other words, in addition to the word prompts and other numeric parametric inputs, the user can introduce an additional model to further indicate the desired output. There are many different ways this is done. | In other words, in addition to the word prompts and other numeric parametric inputs, the user can introduce an additional model to further indicate the desired output. There are many different ways this is done. The important point is that whereas before, users were working with one single model (a) and manually adjusting parameters, with ControlNet users are introducing an additional small model (b) that has much more capabilities of influencing the outputs. | ||
[[File:ControlNetModel.png|center|thumb|600x600px|ControlNet Diagram]] | |||
Revision as of 11:36, 21 August 2023
ControlNet can best be described by the the very scientists who developed it: "We present a neural network structure, ControlNet, to control pretrained large diffusion models to support additional input conditions. The ControlNet learns task-specific conditions in an end-to-end way, and the learning is robust even when the training dataset is small (< 50k)." https://arxiv.org/abs/2302.05543
In other words, in addition to the word prompts and other numeric parametric inputs, the user can introduce an additional model to further indicate the desired output. There are many different ways this is done. The important point is that whereas before, users were working with one single model (a) and manually adjusting parameters, with ControlNet users are introducing an additional small model (b) that has much more capabilities of influencing the outputs.
