而今天要学习的就是阿里推出的新东西-Animate to Anyone,英文比较好的同学应该就能看出来这个东西是要面向谁了。
没错!就是像我这样想要做动漫但是无从下手的萌新。
该项目由阿里巴巴智能计算研究院开发,这个东西厉害就厉害在只需要提供一个静态的角色图和一些预设的动作,然后AI就会让这个角色“动起来”。
论文链接:2311.17117.pdf (arxiv.org)
这个东西可以用在任何“角色”上,不一定非要人型角色,甚至属于各种动漫/卡通角色,具有更广泛的使用范围。
其工作原理也不难:在这个过程中需要一张角色的图像(要具有明确特征的角色图像),然后再提供一系列的动作或者姿势,可以是任何姿势例如跳舞、走路或者其他动作。
这个Driving Pose看起来是不是很眼熟,很像ControlNet里面的Openpose。
在这个技术上涉及到了几个关键步骤:
1、首先是姿势引导:AI系统会先分析提供的动作序列,这些序列会被用来指导图像中的角色如何移动。
2、特征的融合:系统用例如ReferenceNet这类算法来确保动画过程中的角色细节特征保持一致。
3、视频合成:系统通过去噪UNet技术将动作和静态图像合成一个连贯的视频序列,确保角色的动作流程自然。
4、在合成过程中,系统利用空间注意力、交叉注意力和时间注意力等机制,确保视频中的每一帧都与原始图像保持高度一致性。这项技术厉害的地方在于其通用性和高度的自定义能力,用户可以使用任何图像和任意动作序列来创建独特和定制化的视频内容。
不过目前来看这个东西暂时不会开源,可能只会单纯分享部分代码,所以作为个人还是没有办法接触使用到的。
随着AI技术的不断发展,人们对其的担忧也越来越深,不只是技术的滥用,用一张个人照片就能制造出虚假视频用于诈骗或者伪造言论,而那样的“互联网狂澜”似乎很快就要到来。
今天的内容就到这里啦!
其实只是单纯分享下这些AI相关的工具,虽然还没有正式发布但是多关注一下还是没啥坏处的。
这篇笔记内容很无聊我得承认,所以我照例放放美女的照片给大伙养养眼,如果那一天三次元的看厌了请私信我,我下次换二次元的。
那就下篇笔记见啦,拜了个拜!
头一回拿提示词凑字数
正向提示词:
<lora:Chizuru:1>mizuhara_chizuru,outdoors,grass, wall, graffiti(ultra-detailed:1.3), 8k, masterpiece world theater, textured skin, ambient light, realistic shadows, beautiful detailed eyes,1girl (solo:1.3), crop top, choker, torn jeans, cap, leaning against wall, sneakers, cropped jacket, on object, contraposto,cowboy shot,
负面提示词:
blurry, depth of field extra limbs, multple girls, (monochrome:1.4), penetration, watermark, (hair hiding nipples), (wrinkles:1.1), (monotone), 3D, low quality, lowres multiple breasts, low quality lowres mutated hands and fingers, low quality lowres long body, low quality lowres mutation poorly drawn, low quality lowres black-white, low quality lowres bad anatomy, low quality lowres liquid body, low quality lowres liquid tongue, low quality lowres disfigured, low quality lowres malformed, low quality lowres mutated, low quality lowres anatomical nonsense, low quality lowres text font ui, low quality lowres error, low quality lowres malformed hands, low quality lowres long neck, low quality lowres blurred, low quality lowres lowers, low quality lowres low res, low quality lowres bad proportions, low quality lowres bad shadow, low quality lowres uncoordinated body, low quality lowres unnatural body, low quality lowres fused breasts, low quality lowres bad breasts, low quality lowres huge breasts, low quality lowres poorly drawn breasts, low quality lowres extra breasts, low quality lowres liquid breasts, low quality lowres heavy breasts, low quality lowres missing breasts, low quality lowres huge haunch, low quality lowres huge thighs, low quality lowres huge calf, low quality lowres bad hands, low quality lowres fused hand, low quality lowres missing hand, low quality lowres disappearing arms, low quality lowres disappearing thigh, low quality lowres disappearing calf, low quality lowres disappearing legs, low quality lowres fused ears, low quality lowres bad ears, low quality lowres poorly drawn ears, low quality lowres extra ears, low quality lowres liquid ears, low quality lowres heavy ears, low quality lowres missing ears, low quality lowres fused animal ears, low quality lowres bad animal ears, low quality lowres poorly drawn animal ears, low quality lowres extra animal ears, low quality lowres liquid animal ears, low quality lowres heavy animal ears, low quality lowres missing animal ears, low quality lowres text, low quality lowres ui, low quality lowres missing fingers, low quality lowres missing limb, low quality lowres fused fingers, low quality lowres one hand with more than 5 fingers, low quality lowres one hand with less than 5 fingers, low quality lowres one hand with more than 5 digit, low quality lowres one hand with less than 5 digit, low quality lowres extra digit, low quality lowres fewer digits, low quality lowres fused digit, low quality lowres missing digit, low quality lowres bad digit, low quality lowres liquid digit, low quality lowres colorful tongue, low quality lowres black tongue, low quality lowres cropped, low quality lowres watermark, low quality lowres username, low quality lowres blurry, low quality lowres JPEG artifacts, low quality lowres signature, low quality lowres 3D, low quality lowres 3D game, low quality lowres 3D game scene, low quality lowres 3D character, low quality lowres malformed feet, low quality lowres extra feet, low quality lowres bad feet, low quality lowres poorly drawn feet, low quality lowres fused feet, low quality lowres missing feet, low quality lowres extra shoes, low quality lowres bad shoes, low quality lowres fused shoes, low quality lowres more than two shoes, low quality lowres poorly drawn shoes, low quality lowres bad gloves, low quality lowres poorly drawn gloves, low quality lowres fused gloves, low quality lowres bad cum, low quality lowres poorly drawn cum, low quality lowres fused cum, low quality lowres bad hairs, low quality lowres poorly drawn hairs, low quality lowres fused hairs, low quality lowres big muscles, low quality lowres ugly, low quality lowres bad face, low quality lowres fused face, low quality lowres poorly drawn face, low quality lowres cloned face, low quality lowres big face, low quality lowres long face, low quality lowres bad eyes, low quality lowres fused eyes poorly drawn eyes, low quality lowres extra eyes, low quality lowres malformed limbs, low quality lowres more than 2 nipples, low quality lowres missing nipples, low quality lowres different nipples, low quality lowres fused nipples, low quality lowres bad nipples, low quality lowres poorly drawn nipples, low quality lowres black nipples, low quality lowres colorful nipples, low quality lowres gross proportions, short arm, low quality lowres missing arms, low quality lowres missing thighs, low quality lowres missing calf, low quality lowres missing legs, low quality lowres mutation, low quality lowres duplicate, low quality lowres morbid, low quality lowres mutilated, low quality lowres poorly drawn hands, low quality lowres more than 1 left hand, low quality lowres more than 1 right hand, low quality lowres deformed, low quality lowres extra arms, low quality lowres extra thighs, low quality lowres more than 2 thighs, low quality lowres extra calf, low quality lowres fused calf, low quality lowres extra legs, low quality lowres bad knee, low quality lowres extra knee, low quality lowres more than 2 legs, low quality lowres bad tails, low quality lowres bad mouth, low quality lowres fused mouth, low quality lowres poorly drawn mouth, low quality lowres bad tongue, low quality lowres tongue within mouth, low quality lowres too long tongue, low quality lowres big mouth, low quality lowres cracked mouth, low quality lowres dirty face, low quality lowres dirty teeth, low quality lowres dirty pantie, low quality lowres fused pantie, low quality lowres poorly drawn pantie, low quality lowres fused cloth, low quality lowres poorly drawn cloth, low quality lowres bad pantie, low quality lowres yellow teeth, low quality lowres thick lips, low quality lowres bad camel toe, low quality lowres colorful camel toe, low quality lowres bad asshole, low quality lowres poorly drawn asshole, low quality lowres fused asshole, low quality lowres missing asshole, low quality lowres bad anus, low quality lowres bad pussy, low quality lowres bad crotch, low quality lowres bad crotch seam, low quality lowres fused anus, low quality lowres fused pussy, low quality lowres fused crotch, low quality lowres poorly drawn crotch, low quality lowres fused seam, low quality lowres poorly drawn anus, low quality lowres poorly drawn pussy, low quality lowres poorly drawn crotch seam, low quality lowres bad thigh gap, low quality lowres missing thigh gap, low quality lowres fused thigh gap, low quality lowres liquid thigh gap, low quality lowres poorly drawn thigh gap, low quality lowres bad collarbone, low quality lowres fused collarbone, low quality lowres missing collarbone, low quality lowres liquid collarbone, low quality lowres strong girl, low quality lowres obesity, low quality lowres worst quality, low quality lowres low quality, low quality lowres normal quality, low quality lowres liquid tentacles, low quality lowres bad tentacles, low quality lowres poorly drawn tentacles, low quality lowres split tentacles, low quality lowres fused tentacles, low quality lowres missing clit, low quality lowres bad clit, low quality lowres fused clit, low quality lowres colorful clit, low quality lowres black clit, low quality lowres liquid clit, low quality lowres QR code, low quality lowres bar code, low quality lowres censored, low quality lowres safety panties, low quality lowres safety knickers, low quality lowres beard, low quality lowres furry, pony, low quality lowres pubic hair, low quality lowres mosaic, low quality lowres excrement, low quality lowres faeces, low quality lowres shit, low quality lowres futa, low quality lowres testis, low quality lowres lowres, low quality lowres terrible, low quality lowres dirty, low quality lowres feces, low quality lowres organs, low quality lowres fat, low quality lowres thick thighs, low quality lowres low resolution rough, low quality lowres pedophile, low quality lowres bestiality, low quality lowres parody, low quality lowres traditional media, low quality lowres koma, low quality lowres comic, low quality lowres scary, low quality lowres severe, low quality lowres insects, low quality lowres gross scars, low quality lowres twisted human body, low quality lowres irrational human body, low quality lowres sharp fingers, low quality lowres parts of the body out of common sense, low quality lowres murder, low quality lowres beheading, low quality lowres zombie, low quality lowres mummy, low quality lowres graffiti, low quality lowres unfinished picture, low quality lowres terrible quality, low quality lowres Coprophilia, low quality lowres muscular, low quality lowres bald, low quality lowres monk, low quality lowres wrinkly, low quality lowres simple background, low quality lowres realistic, low quality lowres old, low quality lowres scan, low quality lowres touhou, low quality lowres yaoi, low quality lowres gay, low quality lowres femboy, low quality lowres trap, low quality lowres pee, low quality lowres doujinshi, low quality lowres monochrome, low quality lowres meme, low quality lowres demon, low quality lowres monstrous creature, low quality lowres tentacle, low quality lowres self harm, low quality lowres vomit, low quality lowres suicide, low quality lowres death, low quality lowres corpse, low quality lowres bone, low quality lowres skeleton, low quality lowres fingers over 6, low quality lowres framed, low quality lowres historical picture, low quality lowres futanari, low quality lowres shemale, low quality lowres trans gender, low quality lowres dick girl, low quality lowres flat breasts, low quality lowres degenerate ass, low quality lowres retro artstyle, low quality lowres anime screencap,
其他参数:
-
Steps: 30
-
Sampler: Euler a
-
CFG scale: 7
-
Seed: 2366683436
-
Size: 512×512
-
Model hash: e4a30e4607
-
Model: majicmixRealistic_v6
-
Denoising strength: 0.5
-
Clip skip: 2
-
ENSD: 31337
-
Hires upscale: 2
-
Hires upscaler: R-ESRGAN 4x+
-
Lora hashes: “Chizuru: 27cf5ec6a0ac”
-
Version: v1.6.0-2-g4afaaf8a0
文章部分参考内容:
Animate Anyone:从静态图像生成动态视频,可将任意图像角色动画化 – 知乎 (zhihu.com)
动画任何人:角色动画的一致且可控的图像到视频合成 – 知乎 (zhihu.com)
Animate Anyone (humanaigc.github.io)
论文:2311.17117.pdf (arxiv.org)
GitHub – HumanAIGC/AnimateAnyone: Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation
评论0