top of page
Search

新LORA_部署与工作流问题_20260329

  • Writer: issac zhang
    issac zhang
  • Mar 29
  • 3 min read

Updated: Mar 30

我用了huggingface的库去部署自己的lora,但是发现lora并没有用。一开始我以为是我的lora没有任何效果,但是我用了吉普力风格的lora也并没有用。但是吉普力风格的lora仍旧在qwen image这个workflow里是有用的。那就证明要不就是我导入的qwen 2512 lora方式有问题,要不就是qwen 2512这个版本本身就不支持lora。

huggingface的库
huggingface的库
Studio Ghibli Dark Fairytale, close-up of a raised hand forming a symbolic gesture, swirling wave motifs, sun and moon symbols, high-contrast black-and-white print, rough carved linework, flat decorative composition
Studio Ghibli Dark Fairytale, close-up of a raised hand forming a symbolic gesture, swirling wave motifs, sun and moon symbols, high-contrast black-and-white print, rough carved linework, flat decorative composition

破案了,2512 turbo才可以加lora,然后这个lora学的并不好。把关键词“high-contrast black-and-white print, rough carved linework, flat decorative composition”丢掉,就可以看到下图变成了彩色了。

2512 turbo
2512 turbo

zhima_style, close-up of a raised hand forming a symbolic gesture, swirling wave motifs, sun and moon symbols    lora1.5
zhima_style, close-up of a raised hand forming a symbolic gesture, swirling wave motifs, sun and moon symbols lora1.5
zhima_style, close-up of a raised hand forming a symbolic gesture, swirling wave motifs, sun and moon symbols, high-contrast black-and-white print, rough carved linework, flat decorative composition    lora1.5
zhima_style, close-up of a raised hand forming a symbolic gesture, swirling wave motifs, sun and moon symbols, high-contrast black-and-white print, rough carved linework, flat decorative composition lora1.5

用这个图做测试,看看有没有形变.提示词和lora强度统一不变

zhima_style,外星人的侧面,它左手持一部复古“大哥大”无线电话进行通话,外星人满脸期待的看向左上方的类地行星,瞳孔是一颗爱心,它正与地球人进行星际恋爱,外星人占据画面右下方主体,外星人背面是一个巨大的星球,星球上方是是壮丽的带环行星(土星)和一颗遥远的类地行星。画面中漂浮着黑色的爱心符号和闪电/信号折线,构图紧凑且富有叙事性, 线条为主的版画, paper horse print, stamp-like layout, decorative border, rough carved linework, thick-and-thin line variation, flat ink shapes, simplified forms, folk decorative motifs, imperfect registration, visible print pressure variation,
zhima_style,外星人的侧面,它左手持一部复古“大哥大”无线电话进行通话,外星人满脸期待的看向左上方的类地行星,瞳孔是一颗爱心,它正与地球人进行星际恋爱,外星人占据画面右下方主体,外星人背面是一个巨大的星球,星球上方是是壮丽的带环行星(土星)和一颗遥远的类地行星。画面中漂浮着黑色的爱心符号和闪电/信号折线,构图紧凑且富有叙事性, 线条为主的版画, paper horse print, stamp-like layout, decorative border, rough carved linework, thick-and-thin line variation, flat ink shapes, simplified forms, folk decorative motifs, imperfect registration, visible print pressure variation,

openpose 强度0/0.5/1/1.5👇 lora 1.3 开始强度0结束强度1

可以见到openpose确实会影响生成角色的姿势。


controlnet depth anythingv2 0.2/0.3/0.4强度👇 lora1.3 开始强度0结束强度1

可以看出0.4的强度可能是最好的,会有一定程度的形变,但是又同时能够保证画面元素不跑调

Anime Lineart 强度0.4/0.6👇 lora 1.3 开始强度0结束强度1

比depth没那么符合原图设定,会更加天马行空一点

openpose开始强度0结束强度0.5+depth开始强度0结束强度0.5 step2
openpose开始强度0结束强度0.5+depth开始强度0结束强度0.5 step2

这个图毁了👇

openpose开始强度0结束强度0.1+depth开始强度0结束强度1 step2
openpose开始强度0结束强度0.1+depth开始强度0结束强度1 step2

openpose开始强度0结束强度0.5+depth开始强度0结束强度0.5 step6
openpose开始强度0结束强度0.5+depth开始强度0结束强度0.5 step6

Conclusion: step越多相对画质越好,如果单纯用depth和openpose的话,提示词就比较重要。然后用canny edge控制具体的线条。


比如下方的左图提示词是:zhima_style,外星人的侧面,它左手持一部复古“大哥大”无线电话进行通话,外星人满脸期待的看向左上方的类地行星,瞳孔是一颗爱心,它正与地球人进行星际恋爱,外星人占据画面右下方主体,外星人背面是一个巨大的星球,星球上方是是壮丽的带环行星(土星)和一颗遥远的类地行星。画面中漂浮着黑色的爱心符号和闪电/信号折线,构图紧凑且富有叙事性, 线条为主的版画, paper horse print, stamp-like layout, decorative border, rough carved linework, thick-and-thin line variation, flat ink shapes, simplified forms, folk decorative motifs, imperfect registration, visible print pressure variation。

右图的是zhima_style,外星人打电话,paper horse print, stamp-like layout, decorative border, rough carved linework, thick-and-thin line variation, flat ink shapes, simplified forms, folk decorative motifs, imperfect registration, visible print pressure variation,

可以看出有无提示词的区别


所以canny edge加上depth是最好的,又能保证一致性,还能保证有一定程度的发散性。要不就直接用depth.

canny edge强度0.05开始1结束0.5 和depth强度0.1开始1结束1
canny edge强度0.05开始1结束0.5 和depth强度0.1开始1结束1

canny edge low thereshold不要低于100


 
 
 

Comments


© Powered by Zicheng Zhang

bottom of page