最近很火的AI视频,30秒展现一个人的一生,我们来看一下制作流程
包含以下知识点
- 安装ComfyUI + AnimeDiff插件
- 使用Prompt travel描述视频画面
在BatchPromptSchedule这个节点里描述出画面的内容,前面的数字代表对应的帧数
<span class="code-block-extension-codeLine" data-line-num="1"><span class="hljs-attr">"0"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"a new born baby girl lying on a crib crying, top view"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="2"><span class="hljs-attr">"20"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"a new born baby girl lying on a crib crying, top view"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="3"><span class="hljs-attr">"40"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"a 5 years old toddler"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="4"><span class="hljs-attr">"60"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"a 5 years old toddler"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="5"><span class="hljs-attr">"80"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"10 year old girl running"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="6"><span class="hljs-attr">"120"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"10 year old girl running"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="7"><span class="hljs-attr">"140"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"20 year old woman graduates from college, on campus"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="8"><span class="hljs-attr">"160"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"20 year old woman graduates from college, on campus"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="9"><span class="hljs-attr">"180"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"25 year old woman working in office, professional suit"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="10"><span class="hljs-attr">"200"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"25 year old woman working in office professional suit"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="11"><span class="hljs-attr">"220"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"35 year old woman holding a baby, casual clothing"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="12"><span class="hljs-attr">"240"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"35 year old woman holding a baby, casual clothing"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="13"><span class="hljs-attr">"260"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"50 year old woman, looking at viewer, casual clothing"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="14"><span class="hljs-attr">"280"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"50 year old woman, looking at viewer, casual clothing"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="15"><span class="hljs-attr">"300"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"80 year old woman, looking at viewer, casual clothing"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="16"><span class="hljs-attr">"320"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"80 year old woman, looking at viewer, casual clothing"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="17"><span class="hljs-attr">"340"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"90 year old woman, top view, lying on death bed, hospital clothing, eyes closed"</span><span class="hljs-punctuation">,</span></span>
<span class="code-block-extension-codeLine" data-line-num="18"><span class="hljs-attr">"360"</span> <span class="hljs-punctuation">:</span> <span class="hljs-string">"90 year old woman, top view, lying on death bed, hospital clothing, eyes closed"</span></span>
第一次载入这个工作流之后,ComfyUI可能会提示有node组件未被发现,我们需要通过ComfyUI manager安装,它会自动找到缺失的组件并下载安装(!!需要网络通畅)。
点击ComfyUI Manager按钮打开组件管理
再点击Install Missing Custom Nodes安装组件
安装完成后要重启ComfyUI才能完成载入刚才缺失的组件。
如果网络状态不好,可能会导致下载组件失败,需要多试几次
下载模型DreamShaper 8。
将safetensors文件放入文件夹ComfyUI > models > checkpoints中。
刷新浏览器标签页。 找到节点“Load Checkpoint”。点击ckpt_name下拉菜单,选择dreamshaper_8模型。
下载VAE。将文件放入文件夹ComfyUI > models > vae中。
刷新浏览器页面。
在Load VAE节点中,选择刚刚下载的文件。
下载 AnimateDiff v1.5 v2 动作模型。
将其放入文件夹 ComfyUI > custom_nodes > ComfyUI-AnimateDiff-Evolved > models 中。
刷新浏览器页面。
在AnimateDiff Loader节点中,在model_name下拉菜单中选择mm_sd_v15_v2.ckpt。
这个工作流程使用了BadDream负面嵌入在负面提示中。
它是为Dream Shaper模型训练的负面嵌入。
下载BadDream嵌入文件。
将文件放入ComfyUI > models > embeddings目录中。
点击“Queue Prompt”开始生成视频。
进度条将出现在KSampler节点上。
当完成时,将在视频合并节点中看到视频出现。
链接:https://juejin.cn/post/7298167437526007808
来源:稀土掘金
著作权归作者所有。商业转载请联系作者获得授权,非商业转载请注明出处。
文章评论