IC Light Changer For Videos With AnimateDiff and ComfyUI

Jerry Davos AI
Jerry Davos AI
6,523
0
Published 2024-07-06
IC light changer for Videos using ComfyUI and AnimateDiff

1) Workflow: drive.google.com/drive/folders/16Aq1mqZKP-h8vApaN4…

2) Run this workflow without setup in RunComfy: www.runcomfy.com/comfyui-workflows/comfyui-ic-ligh…

3) My Patreon: www.patreon.com/jerrydavos
I post early access and other workflows like this here

_______________________________________________________________________________________


INSTALLATION:

Custom Nodes:
1. github.com/daxcay/ComfyUI-JDCN.git
2. github.com/bronkula/comfyui-fitsize.git
3. github.com/kijai/ComfyUI-IC-Light.git
4. github.com/kijai/ComfyUI-KJNodes.git
5. github.com/mcmonkeyprojects/sd-dynamic-thresholdin…
6. github.com/cubiq/ComfyUI_essentials.git
7. github.com/giriss/comfy-image-saver.git
8. github.com/M1kep/ComfyLiterals.git
9. github.com/theUpsider/ComfyUI-Logic.git
10. github.com/Kosinkadink/ComfyUI-VideoHelperSuite.gi…
11. github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved…
12. github.com/Kosinkadink/ComfyUI-Advanced-ControlNet…
13. github.com/shiimizu/ComfyUI_smZNodes.git
14. github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes.gi…
15. github.com/Nourepide/ComfyUI-Allor.git
16. github.com/WASasquatch/was-node-suite-comfyui.git
17. github.com/Fannovel16/ComfyUI-Video-Matting.git
18. github.com/Fannovel16/comfyui_controlnet_aux.git
19. github.com/comfyanonymous/ComfyUI_experiments.git
20. github.com/ltdrdata/ComfyUI-Impact-Pack.git

ControlNet Models:
1. civitai.com/models/80536?modelVersionId=85428
2. huggingface.co/TencentARC/T2I-Adapter/blob/main/mo…
Target Location: Comfyui\models\controlnet

IC model
• huggingface.co/lllyasviel/ic-light/tree/main
Put in Comfyui\model\unet

AnimateDiff Motion Module:
• civitai.com/models/139237?modelVersionId=154097
Location: ComfyUI\models\animatediff_models

Other Models
1) SAM: dl.fbaipublicfiles.com/segment_anything/sam_vit_b_…
2) FaceDetect: [It will be Auto downloaded during install]

Location Sam: ComfyUI/models/sams
Location FaceDetect: ComfyUI\models\mmdets\bbox


_________________ (Sources) _____________
1) www.tiktok.com/@monominjii
2) www.instagram.com/reel/C3FyWgYIc_x/
3)    / @helenpeng  
4) www.instagram.com/p/C4Lih8DIhBq/
5) www.instagram.com/reel/C19CswgrLD3/
Some are unknown...






___________________________________________________________________________________________
Timestamps:

0:00 - Renders
0:41 - Preview
1:00 - Installation
1:49 - IC Workflow - Part 1 - Vid2Vid
7:43 - IC Workflow - Part 2 - Passes
9:22 - Light Maps
11:00 - IC Workflow - Part 2 - Img2Img
12:55 - RunComfy.com
14:30 - Credits



________________________________________________________________________________________
Music Credits:

1) Luke Bergs - Aurora - freetouse.com
2) AgusAlvarez & Markvard - Beautiful Liar - freetouse.com
3) Human Connection - Instrumental Hans Johnson - Artlist.io
4) Top of the Hill Lymez - Artlist.io


_____________________________________________________________________________________

SEO:

IC Light
Light Changer comfyui
relight comfyui
Relighting video
Animatediff control net
Animatediff animation
Stable Diffusion animation
comfyui animation
animatediff webui
animatediff controlnet
animatediff github
animatediff stable diffusion
Controlnet animation
how to use animatediff
animation with animate diff comfyui
how to animate in comfy ui
animatediff prompt travel
animate diff prompt travel cli
prompt travel stable diffusion
animatediff comfyui video to video
animatediff comfyui google colab
animatediff comfyui tutorial
animatediff comfyui install
animatediff comfyui img2img
animatediff vid2vid comfyui
video 2 video
video to video
comfyui-animatediff-evolved
animatediff controlnet animation in comfyui
-------------------------------------------------------------------
All Comments (21)
  • @piorewrzece
    Superb and clean tutorial. Also the attention to sharing all the links and files is THE BEST.
  • @张辰-r5o
    This is awesome and very detailed, it saved me a lot of trouble, thumbs up and thanks for your hard work.
  • @t8levin
    Is it possible to change the lighting without changing the main subject in the video? it creates too many deformities and it's not really usable for professional work
  • @sam-ss9rn
    Thank you. I am trying this one. I have question. Whenever running each bach(50), little bit defference occurs. Any way to avoid this difference?
  • @ZainSarwar5
    Error Motion module 'motionModel_v01.ckpt' is intended for SD1.5 models, but the provided model is type SDXL.
  • @JosefK2275
    I don't get why the file output node has a # symbol. Can I change it with a normal save path?
  • @calvinherbst304
    Help! First off, thank you so much for the tutorial. I can tell you put a lot of effort into not only the project it's self, but the recourses for sharing this with us. I got everything set up and working correctly and ran a few quick generations to make sure all the models were installed. I then updated my control net custom nodes and now, even when I revert to your original work flow, get the error: Error occurred when executing ACN_AdvancedControlNetApply: ControlBase.set_cond_hint() takes from 2 to 4 positional arguments but 5 were given - any ideas? Thanks!
  • @Fucatstory
    Hello bro, I have an error in Ksampler. T2IAdapter Advanced.control merge_inject() missing 1 required positional argument: 'output_dtype'
  • @user-eq9ge3vm5y
    I'm not very familiar with IClight, can it be used with LCM?