Stable Diffusion ããã³ãããžã§ãã¬ãŒã¿ãŒ
ããŒã¯ãŒãã®èªåéã¿ä»ãããã¬ãã£ãããã³ãããBooru圢åŒã¿ã°ã«å¯Ÿå¿ããSDXLããã³ãããçæããŸãã
ã·ã³ãã«ãªã¢ã€ãã¢ãããéã¿ä»ããããSDæ§æãž
èŠãããã®ã説æããã°ããã®Stable Diffusionããã³ãããžã§ãã¬ãŒã¿ãŒããšã³ãžãã¢ãªã³ã°ãåŒãåããŸãã䞊ã³é ãæŽããã¿ã°ã(keyword:1.2)ãšãã匷調ã®éã¿ããããŠéã¿ä»ããããå質ãã¬ãã£ãã¯ã¹ããã®ãã¹ãŠãããã©ãŠã¶å ã§æ°ç§ã§çµã¿äžãããŸãã
ã¢ã€ãã¢ãå ¥å
ãéšã®ãµã€ããŒãã³ã¯ãªè·¯å°ãããæ¬æ Œçãªã·ãŒã³ã®ããªãŒããŸã§ãå¹³æãªèšèã§ã³ã³ã»ãããå ¥åããŸããæ¯åœèªã§æžããŠããæé©åãããè±èªã®åºåãåŸãããŸãã
Magic Enhanceãæ§æãæ§ç¯
ã¯ã³ã¯ãªãã¯ã§ãã¢ã€ãã¢ãSDã«é©ããããŒã¯ã³ã®äžŠã³ãžãšåæ§æãã(masterpiece, best quality, highly detailed:1.2)ã®ãããªéã¿ä»ããããå質ãããã¯ãå é ã«çœ®ãããã®ã·ã§ãããæ±ºå®ã¥ããèŠçŽ ã«åŒ·èª¿ã®éã¿ãé©çšããŸãã
SDã€ã³ã¿ãŒãã§ãŒã¹ã«ã³ããŒ
çµæãAUTOMATIC1111ãComfyUIãForgeã«ãã®ãŸãŸè²Œãä»ããŸãã倿Žãå¿ èŠã§ãã?Edit ã¢ãŒãã«åãæ¿ããã°ãã¿ã°ãæäœæ¥ã§æžãçŽã代ããã«ãå¹³æãªæç€ºã§ããã³ããã調æŽã§ããŸãã
ã¢ãã«ãæèããããã³ãããšã³ãžãã¢ãªã³ã°ããStable Diffusionã«äœãããããã
Stable Diffusionã¯ããã³ãããããŒã¯ã³ã®äžŠã³ãšããŠèªã¿åããããããããŒã¯ã³ãããã€ãžã³ã°ã®éãæ³šæã奪ãåããŸãããã¬ãŒã³ãªããã¹ãããã¯ã¹ã«ãdetailed castle, dramatic lightingããšå ¥åãããšããµã³ãã©ãŒã¯äž¡æ¹ã®ãã¬ãŒãºãåçã«æ±ããŸããåœç€Ÿã®Stable Diffusionããã³ãããžã§ãã¬ãŒã¿ãŒã¯ãã¢ã€ãã¢ãéã¿ä»ããããæ§æãžãšåæ§æãã(dramatic lighting:1.2)ã®ãããªåŒ·èª¿ãé©çšããããšã§ãããªããéèŠããéšåãå®éã«æ¡æ£ããã»ã¹ãå°ãããã«ããŸããSDã®ãã§ãã¯ãã€ã³ããåŠç¿æã«æ³å®ããŠãããšããã被åäœããã¹ã¿ã€ã«ãžãšã¿ã°ã䞊ã¹ãæãéèŠãªããŒã¯ã³ãåã«çœ®ããæ³šæãèããŠããŸãåãèã®èšèãåãèœãšããŸãã
ãã§ãã¯ãã€ã³ãããšã«ç°ãªãæ¹èšã䜿ãåããã®ã§ã¯ãªãããžã§ãã¬ãŒã¿ãŒã¯ãSD 1.5ãSDXLãBooruã§åŠç¿ãããã¢ãã¡ã¢ãã«ã®ããããã確å®ã«è§£éã§ãããå®çžŸããäžã€ã®æ§é ãçæããŸããéã¿ä»ããããå質ãã¬ãã£ãã¯ã¹(masterpiece, best quality, highly detailed:1.2)ã«ç¶ããŠãäžæã®è¢«åäœèšè¿°ããããŠã·ãŒã³ã®èŠèŠçãªçްéšãããªãã¡ã©ã€ãã£ã³ã°ã質æãé°å²æ°ãæããããã£ãããšéã¿ä»ããããã«ã³ãåºåãã®çŸçã¿ã°ã10å䞊ã³ãŸãããã®åœ¢åŒã¯å®è¡ã®ãã³ã«äžè²«ããŠãããããéã¿ãã©ãã§ç· ããããã¹ã¿ã€ã«ã¿ã°ãã©ãã§å·®ãæ¿ããããããªã¬ãŒã¯ãŒããã©ãã«å ¥ããããåžžã«æ£ç¢ºã«åãããŸããã¢ã€ãã¢ã§ã¯ãªãç»åããå§ããå Žåã¯ãåœç€Ÿã®ãªããŒã¹ç»åããã³ãããã¡ã€ã³ããŒãããŸãå ç»åããèŠèŠçãªçްéšãæœåºããŸãã
çæãããã®ã¯ãã¹ãŠãAUTOMATIC1111ãComfyUIãForgeã«ã³ããŒ&ããŒã¹ãããŠãã䜿ããŸãããã®3ã€ã®ã€ã³ã¿ãŒããªã¿ã¯ããããåã(keyword:weight)ãšããåŒ·èª¿ã®æ £ç¿ã«åŸãããã§ããæ§é åãããåºåã¯LoRAã®ããªã¬ãŒã¯ãŒãã®ããã®ããããªæ¿å ¥äœçœ®ãæ®ãã®ã§ãããŒã¯ã³ã®äžŠã³ã厩ãããšãªãã«ã¹ã¿ã ã®ã¹ã¿ã€ã«ããŒããŒãå·®ã蟌ããŸããããã«ããã£ããéã¿ä»ããããããã³ããã¯ã¬ã€ãã³ã¹ã®å§åãå¿ èŠãšããªããããè²ãé£ãã§ã³ã³ãã©ã¹ããæœ°ããã»ã©ã¬ã€ãã³ã¹ãäžããªããŠããéåžž5ãã8ãšããäžçšåºŠã®CFGã¹ã±ãŒã«å€ã§å®è¡ã§ããŸããã¢ã€ãã¢ã¯äžåºŠå ¥åããã°ãããšã¯ã¿ã°ãæžãçŽã代ããã«ãã·ãŒãã詊ãããšã«GPUã®æéã䜿ããŸãã
- èªåã®(keyword:1.2)匷調ã®éã¿ä»ã
- ãã¹ãŠã®ããã³ããã«éã¿ä»ããããå質ãã¬ãã£ãã¯ã¹
- ã¢ãã¡ãã§ãã¯ãã€ã³ãåãã®Booruã¿ã°ã®ç©ã¿éã
- AUTOMATIC1111ãComfyUIãForgeã«ãã®ãŸãŸè²Œãä»ãå¯èœ
éã¿ä»ããããSDããã³ããã§æãç«ã€6ã€ã®ã¯ãŒã¯ãããŒ
ãã§ãã¯ãã€ã³ããããã人ããå¶äœããŒã ãŸã§ãå ¥åããã¢ã€ãã¢ãéã¿ä»ããããStable Diffusionæ§æãžãšæ¥ã å€ããŠããã®ã¯ã次ã®ãããªäººãã¡ã§ãã
ã¢ãã¡ã¢ãŒãã£ã¹ã
ã¢ãã¡ãã§ãã¯ãã€ã³ãåãã«èª¿æŽãããBooruã¹ã¿ã€ã«ã®ã¿ã°ã®ç©ã¿éããçæããŸããã¬ã³ããªã³ã°ãéããŸãšãŸãã®ãã现éšãžãšå°ããéã¿ä»ããããå質ãã¬ãã£ãã¯ã¹ä»ãã§ãã
ã³ã³ã»ããã¢ãŒãã£ã¹ã
1è¡ã®ããªãŒããéã¿ä»ããããSDXLããã³ããã«å€ããã¬ã³ããªã³ã°ã®ãã³ã«ã¿ã°ãæžãçŽã代ããã«ãã·ãŒãã詊ããŠå埩ã§ããŸãã
ComfyUIããŒããã«ããŒ
æ§é åããããããããéã¿ä»ããããããã³ããããã¹ããCLIP Text EncodeããŒãã«æµã蟌ããŸããè€éãªã¯ãŒã¯ãããŒã°ã©ãå šäœã§åŒ·èª¿ã®éã¿ãæäœæ¥ã§èª¿æŽããå¿ èŠã¯ãããŸããã
ã²ãŒã ã¢ã»ããã¯ãªãšã€ã¿ãŒ
ã¹ãã©ã€ããç°å¢ããã£ã©ã¯ã¿ãŒã·ãŒãåãã«äžè²«ããããã³ãããã³ãã¬ãŒããäœæããŸããéã¿ä»ããããã¹ã¿ã€ã«ãããã¯ã¯åºå®ãããŸãŸã被åäœã ããå·®ãæ¿ããããŸãã
LoRAãã¬ãŒããŒ
ã«ã¹ã¿ã LoRAã¢ãã«åãã«ã䞊ã³é ã®æã£ããã¹ãããã³ãããäœæããŸããããªã¬ãŒã¯ãŒãããåºæ¬ãšãªã被åäœãã¹ã¿ã€ã«ã®ã¿ã°ãããããã«åãåããããŸãã
SDåå¿è
äœãæãã®è©Šè¡é¯èª€ãçããŸããçæãããåºåãäžã€ã²ãšã€ç ç©¶ããã°ãçµéšè±å¯ãªããã³ããäœæè ãã©ãããŒã¯ã³ãéã¿ä»ãããã¿ã°ã®ç©ã¿éãã䞊ã¹ãŠããã®ããåãããŸãã
å ¥åããã¢ã€ãã¢ãšãæäœæ¥ã§çµãã ã¿ã°ã®ç©ã¿éãã®æ¯èŒ
Stable Diffusionã§ã¯ãããã³ããã®è³ªãã¬ã³ããªã³ã°ã®è³ªã決ããŸããããã§ã¯ãå°çšã«äœãããStable Diffusionããã³ãããžã§ãã¬ãŒã¿ãŒããèªåã§ã¿ã°ãæžãå Žåããã¢ãã«ãåããªãæ±çšã®ããã³ããããŒã«ã«é Œãå Žåãšãã©ãæ¯èŒãããã®ããèŠãŠãããŸãã
| æ©èœ | ImaginPrompt | æäœæ¥ã§ã®ã¿ã°èšè¿° | æ±çšããã³ããããŒã« |
|---|---|---|---|
| ããŒã¯ã³ã®éã¿ä»ãæ§æ | â (keyword:1.2)ã®åŒ·èª¿ãèªåã§é©çš | â ïž æäœæ¥ã§ã®è©Šè¡é¯èª€ã«ããèª¿æŽ | â éåžžã¯ãã¬ãŒã³ããã¹ãã®ã¿ |
| å質ã¿ã°ã®ãã¬ãã£ãã¯ã¹ | â ãã¹ãŠã®ããã³ããã®å é ã«(masterpiece, best quality:1.2) | â ïž äœæ¥ã®éäžã§å¿ããã¡ | â SDã®å質ã¿ã°ãäžåãªã |
| äžè²«ããããã³ããæ§é | â å®è¡ã®ãã³ã«åãéã¿ä»ãã¿ã°ã®ç©ã¿éã | â ïž äœæ¥ã®ãã³ã«æ§é ãããã | â 䞊ã³é ã®ãªãèªç±åœ¢åŒã®ããã¹ã |
| Booruã¿ã°ã®æ £ç¿ | â ã¢ãã¡ãã§ãã¯ãã€ã³ãã«å¯Ÿå¿ | â ïž ã¿ã°ãªã¹ãã®æèšãå¿ èŠ | â ãã§ãã¯ãã€ã³ããæèããŠããªã |
| 䜿ããããã³ãã1ã€ãããã®æé | â ã·ã³ãã«ãªã¢ã€ãã¢ããæ°ç§ | â ïž æäœæ¥ã®åŸ®èª¿æŽã«æ°å | â ïž éããSDåãã®ä¿®æ£ãå¿ èŠ |
| LoRAããªã¬ãŒã®äœå° | â ããããªæ¿å ¥äœçœ®ãç¢ºä¿ | â å®å šãªæåå¶åŸ¡ | â ïž ããªã¬ãŒãæ§é ã厩ãããšããã |
ææžãã®ã¿ã°ã¯å®å šãªå¶åŸ¡ãäžããŠãããŸãããæéãšå°éç¥èãèŠããŸããæ±çšããŒã«ã¯æéãç¯çŽã§ããŸãããSDã®æ§æãç¡èŠããŸãããã®ãžã§ãã¬ãŒã¿ãŒã¯äž¡æ¹ãå ŒãåããŠããŸããéã¿ä»ããããäžè²«ããæ§é ã®ããã³ãããæ°ç§ã§åŸãããããããã¹ãŠã®ããŒã¯ã³ã¯ããªããç·šéã§ãããŸãŸã§ãã
ããã·ã£ãŒããªStable Diffusionã¬ã³ããªã³ã°ã®ããã®ãã¯ããã¯
ð¡ éã¿ã¯0.8ãã1.4ã®ç¯å²ã«ä¿ã€
1.5ãè¶ ããå€ã¯æ§å³ãæªããè²ãé£ã°ããŸãã(keyword:1.4)ã«ããŠãèŠçŽ ãçŸããªããªããéã¿ãããã«äžããã®ã§ã¯ãªããèšãæããããããã³ããã®ããåãžç§»åãããŸãããã
ð¡ ã¿ã°ã®ç©ã¿éãããã§ãã¯ãã€ã³ãã«åããã
çæãããéã¿ä»ãã¿ã°ã®ç©ã¿éãã¯ãSD 1.5ãBooruã§åŠç¿ãããã¢ãã¡ã¢ãã«ã§ã¯ãã®ãŸãŸæ©èœããŸããããå®å šãªæç« ãæ±ããSDXLã§ã¯ãEdit ã¢ãŒãã䜿ã£ãŠäžéšã®ã¿ã°ããã¬ãŒãºãžãšããããããŸãã圢åŒã®äžäžèŽã¯ãæ¿ã£ããããªãŒãããå€ããã¬ã³ããªã³ã°ã®ããããåå ã§ãã
ð¡ 匷ãããã³ããã«ã¯äžçšåºŠã®CFGãåããã
ãã£ããéã¿ä»ããããããã³ããã¯ãã¬ã€ãã³ã¹ãããŸãå¿ èŠãšããŸãããSDXLã§ã¯CFG 6ãã7ãããããå§ããŸãããã10ãè¶ ããŠäžããŠãããããªãããããŠãã¯èª¿æŽãã¹ããªã®ã¯ã¹ã±ãŒã«ã§ã¯ãªãããã³ããã§ãã
ð¡ LoRAããªã¬ãŒã¯è¢«åäœãããã¯ã®åŸã«çœ®ã
ããªã¬ãŒã¯ãŒãã¯è¢«åäœã®èšè¿°ã®çŽåŸãéã¿ä»ããããã¹ã¿ã€ã«ã¿ã°ã®åã«æ¿å ¥ããŸãããããããšãLoRAã被åäœãå°ãã€ã€ããã®åŸã«ç¶ãçŸçããŒã¯ãŒããšç«¶åããªããªããŸãã
ãããã質å
(word:1.2)ãšããéã¿ä»ãæ§æã¯ãå®éã«äœãããã®ã§ãã?+
ããã€ãžã³ã°ã®éããã®ããŒã¯ã³ã®æ³šæã®éã¿ãåå¢ãããã¢ãã«ã«ãããåªå ãããŸãã1.2ãšããå€ã¯20ããŒã»ã³ã匷ã匷調ãã0.8ã¯åŒ±ããŸããåœç€Ÿã®ãžã§ãã¬ãŒã¿ãŒã¯ãã·ãŒã³ã決å®ã¥ããèŠçŽ ã«ãããã®éã¿ãèªåã§é©çšãããããæäœæ¥ã§èª¿æŽããå¿ èŠã¯ãã£ãã«ãããŸããã
ãžã§ãã¬ãŒã¿ãŒã¯ãã¬ãã£ãããã³ãããæžããŠãããŸãã?+
ããããåçµæã¯ãéã¿ä»ããããå質ãããã¯(masterpiece, best quality, highly detailed:1.2)ãå é ã«çœ®ãããæé©åãããããžãã£ãããã³ãã1ã€ã§ãããã®ãããã¯ã ãã§ãããã§ãã¯ãã€ã³ããå€ãã®äœå質ãªåºåããé ãããŸããæãå¢ããããŠã©ãŒã¿ãŒããŒã¯ã®æåãå ¥ããšãã£ãé åºãªã¢ãŒãã£ãã¡ã¯ãã«ã¯ãåå©çšã§ãããã¬ãã£ããªã¹ããAUTOMATIC1111ãComfyUIã«ä¿åããŠãããã¬ã³ããªã³ã°ã®ãã³ã«çµã¿åãããŠãã ããã
ã¿ã°åœ¢åŒãšèªç¶èšèªãã©ã¡ãã®ããã³ããã䜿ãã¹ãã§ãã?+
ã¿ã°åœ¢åŒã®ã»ããç¡é£ãªæ¢å®ã§ããSD 1.5ãšã»ãšãã©ã®ã¢ãã¡ã¢ãã«ã¯ã¿ã°ã®ãããªãã£ãã·ã§ã³ã§åŠç¿ãããŠãããSDXLã¯éã¿ä»ããããã«ã³ãåºåãã®ã¿ã°ããå®å šãªæç« ãšåãããã確å®ã«è§£éããŸããã ããããããžã§ãã¬ãŒã¿ãŒã¯ã©ã®ãªã¯ãšã¹ãã«ãäžè²«ããäžã€ã®æ§é ãçæããŸããéã¿ä»ããããå質ãã¬ãã£ãã¯ã¹ãäžæã®è¢«åäœèšè¿°ããããŠéã¿ä»ããããçŸçã¿ã°ã10åã§ããSDXLã®ã¬ã³ããªã³ã°ã§æµãããããªæç« ã奜ããªããEdit ã¢ãŒãã䜿ã£ãŠã¿ã°ããã¬ãŒãºãžãšããããŠãã ããã
çæãããããã³ããã«LoRAã®ããªã¬ãŒã¯ãŒãã远å ã§ããŸãã?+
ã¯ããåºåã¯ãã¬ãŒã³ããã¹ããªã®ã§ãLoRAã®ããã¥ã¡ã³ããæšå¥šããå ŽæããããŠãã¯è¢«åäœèšè¿°ã®çŽåŸã«ãããªã¬ãŒã¯ãŒããæ¿å ¥ã§ããŸãããžã§ãã¬ãŒã¿ãŒã¯è¢«åäœãšã¹ã¿ã€ã«ã®ãããã¯ãäºæž¬ãããã䞊ã³ã§ä¿ã€ãããããªã¬ãŒã¯æ¢åã®åŒ·èª¿ã®éã¿ãä¹±ãããšãªããããã«åãŸããŸãã
ãããã®ããã³ããã¯AUTOMATIC1111ãComfyUIãForgeã§äœ¿ããŸãã?+
ã¯ãã3ã€ã®ã€ã³ã¿ãŒãã§ãŒã¹ã¯ããããåã(keyword:weight)ã®åŒ·èª¿æ§æã«å¯Ÿå¿ããŠãããããçæãããããã³ããã¯ããã³ããæ¬ã«ãã®ãŸãŸè²Œãä»ããããŸããComfyUIã®ãŠãŒã¶ãŒã¯ã倿ãªãã§ããµã³ãã©ãŒã«æ¥ç¶ãããããžãã£ãã®CLIP Text EncodeããŒãã«ããã¹ããå ¥ããããŸãã
Stable Diffusionããã³ãããžã§ãã¬ãŒã¿ãŒã¯è²»çšãããããŸãã?+
ãã¹ãŠã®ãŠãŒã¶ãŒãæ¯æ¥ç¡æã®ã¯ã¬ãžãããåãåããããŠã³ããŒããã€ã³ã¹ããŒã«ãäžèŠã§ããã¹ãŠããã©ãŠã¶å ã§åäœããŸãããã®æ ã¯éåžžã®ããã³ããäœæã®äœæ¥ããŸããªããŸãããèªèº«ã®GPUã®æéã䜿ãã®ã¯ãããŒã«ã«ã®Stable Diffusionç°å¢ã§çµæãã¬ã³ããªã³ã°ãããšãã ãã§ãã
CFGã¹ã±ãŒã«ã¯ããã³ãããšã©ãé¢ä¿ããŸãã?+
CFGã¹ã±ãŒã«ã¯ããµã³ãã©ãŒãã©ãã ãå³å¯ã«ããã³ããã«åŸãããå¶åŸ¡ããŸããéã¿ä»ãããã䞊ã³ã®æŽã£ãããã³ããã¯äžçšåºŠã®å€ãSDXLã§ããã5ãã8ã§æã¡ããããèªç¶ãªè²ãšã³ã³ãã©ã¹ããä¿ã¡ãŸãã匱ãããã³ããã¯ãåŸãããããã«ã¬ã€ãã³ã¹ãäžããããåŸããé«ãCFGã¯ãã©ããªãã¬ãã£ãããã³ããã§ãå®å šã«ã¯çŽããªãé床ãªåœ©åºŠãæããŸãã
æè¡çãªããšãæžãå¿ èŠããããŸããããããšãç»åã説æããã ãã§ããã§ãã?+
ç»åã説æããã ãã§å€§äžå€«ã§ãã被åäœãã·ãŒã³ãé°å²æ°ããèªç¶ã«æããã©ããªèšãåãã§ãããã®ã§å¹³æãªèšèã§å ¥åããŠãã ãããæè¡çãªå±€ãã€ãŸãããŒã¯ã³ã®äžŠã³ã匷調ã®éã¿ãå質ã¿ã°ã¯ãžã§ãã¬ãŒã¿ãŒãåŒãåããŸããã¢ã€ãã¢ã®äžã®å ·äœçãªåè©ãç確ãªåœ¢å®¹è©ã¯ãã¯ã£ãããšçãã®å®ãŸã£ãã¿ã°ã®ç©ã¿éããçã¿åºããŸãã
ä»ã®AIããŒã«
Midjourneyããã³ãããžã§ãã¬ãŒã¿ãŒ
ã·ã³ãã«ãªã¢ã€ãã¢ãããã¢ã¹ãã¯ãæ¯ãstylizeã®ãã©ã°ãåããããã©ã¡ãŒã¿è±å¯ãªMidjourneyããã³ãããäœæããŸãã
ãªããŒã¹ç»åããã³ãããã¡ã€ã³ããŒ
ã©ããªç»åã§ãã¢ããããŒãããã°ããããåçŸããããã³ãã圢åŒã®èšè¿°ãåãæ»ããŸãã
DALL-E 3ããã³ãããžã§ãã¬ãŒã¿ãŒ
çãã¢ã€ãã¢ããDALL-E 3ã®ã¬ã³ããªã³ã°åãã«èª¿æŽããã詳现ãªèªç¶èšèªããã³ãããžãšå€æããŸãã