top of page
Search

2024/03/07

  • Writer: issac zhang
    issac zhang
  • Mar 7, 2024
  • 2 min read

#I start to use Wix website to record my daily work.


My reflection about my AI involved animation exploration is that :


1.The current technique route is applicable so far, but I still need to make a little bit change for this, such as training a more precise Lora model or combine other different techniques to get more a precise result .


2.I need to build up my personal woodblock animation ComfyUI workflow by using different techniques,such as: Adaptor or Instant ID...


What I am done today:

  1. 15 versions of Lora Ai Models have been generated at one time. obviously, It is necessary to compare those 15 models by using the same prompt and parameters under the same test condition(XYZ plot test). The purpose is that we need to select a good model that can understand prompts properly with good style transferability. So, I have tested those 15 Lora by dividing them into 3 groups, We can tell a Lora model if it is fit with our aesthetic and imagination from visual directly. the key parameter setting is: 1) prompt

2)sampler:

3)Lora:

2.analyse the result (from Lora 00001 to Lora 00028):

We can tell some of those Lora model understand the prompt and give us a quite a interesting result that show a huge potential for style transferability,but its flaws including several facet from the wrong body structure,misunderstanding the prompt to meaningless elements.


3.Install the custom ComfyUI node that maybe used in future work,see images below👇


4.Searching and learning the Convert Sketch into image Tutorial to build up my personal custom Comfyui workflow.


Potential useful link 👇:

Problems that need to be solved:

1:Adaptor & Instant node workflow for style transfer test.

2.turn the outlined character design into colored version.


Questionsthat need to be solved:

1.what's the difference between Instant ID and adaptor?


2.is it works for the workflow idea from line to styleframe and 折纸动画


Recent Posts

See All
20250702 Supervision Meeting

Here is the Speech draft. P1. As you can see, here is the refined custom workflow for AI-integrated digital woodblock print animation,...

 
 
 

Comments


© Powered by Zicheng Zhang

bottom of page