Posts
Comfyui face swap video reddit
Comfyui face swap video reddit. The face model is not similar to a checkpoint or a LoRA. Hi guys, I used a111 for some time and now I'm switching to comfyui (portable). But it gave better results than I thought. However, I am noticing that the resolution of the video goes down after the processing. Let us know if you find it useful and stay tuned for the next post! DISCLAIMER: all images here are generated. I hav no idea how did you even made a video faceswap in A1111 with reactor. The general idea and buildup of my workflow is: Create a picture consisting of a person doing things they are known for/are characteristic for them (i. This is another implementation of face swapping. Typically resulted in cutoff head, annoying head positions, etc. FILM VFI (Frame Interpolation using Learned Motion) generate intermediate frames between images, effectively creating smooth transitions and enhancing the fluidity of animations. DM/comment for question or your experiential needs. I have to push around 0. reactor is a castrated version of face fusion that can be used directly in A1111. In either case, you must load the target image in the I2I section of the workflow. Please keep posted images SFW. The "FACE_MODEL" output from the ReActor node can be used with the Save Face Model node to create a insightface model, then that can be used as a ReActor input instead of an image. It's perfect for modifying a movie or TV show clip. I am looking to do a face swap on the following video. 4. My approach is to split the video into individual frames, use Segment Anything to obtain the human mask, then use VAE inpaint encoder to convert it into latent space. Well I can get it working fine (I'm using ReActor but have tried vanilla roop), but the faces are just all pretty low-res. I would like to just be able to face swap the eyes area, so i can make a more consistent look. Forget face swap. That said, I'm looking for a front-end face swap, something that will inject the face into the mix at the point of ksampler, so if I prompt for something like Freckles they won't get lost in the swap/upscale but I've still got my likeness. You can also use ctrl button to select multiple faces. Here is the… Hi, i am trying to perform face swap on animal characters on children's storybooks. Also watch Laten't Vision's vids and tutorials. google. The way I could see it working is you start your work flow with an image of a pose fed into controlnet and/or a desciprtive prompt to generate your base, then just has you would use Reactor with a picture of a model to face swap to, you could also have the ability to feed it specific pictures of the target body partsleft arm, right arm Thanks. Does anyone know of a "head swap" workflow - not just face, but entire head. You can swap faces in individual images or all images in a directory. I would like to be able to face swap to achieve a more consistent character. Our tool works well even if there are many people in the video. I could have something that seems entirely cartoonish with an eerie, lifelike face. You can't use that model for generations/ksampler, it's still only useful for swapping. Since version 0. Should the latter be true, what's the current to-go software to perform face swaps on movies? Thanks! Put ImageBatchToImageList > Face Detailer > ImageListToImageBatch > Video Combine. 8 even. 4) Then you can cut out face and redo-it with IP Adapter. But what is good FaceSwap app you don't have video cutter that can cut by person detection, face detection, or face angle. This video specfically addresses clothing replacement: Face + Pose + Clothing. I wanted to be able to generate a simple square image of a well framed head and face that could be fed without modification to the ReActor face swap node, I found the normal shot control prompts (medium closeup, straight on, looking at viewer, etc. /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. Still using the same inswap128 model in a1111 and the face quality is so much better, what am I doing wrong? Here's FaceSwap with Reactor with a very cool optional, which is FaceAnalysis. Additionally Batch Face Swap sometimes doesn't detect the face and the process is getting too complicated. (just the short version): photograph of a person as a sailor with a yellow rain coat on a ship in the rough ocean with a pipe in his mouth OR photograph of a young man in a sports car Thanks for the reply. Now I'm seeing this FaceSwapLab module for A1111 and looks very interesting, what I'm not sure is if you can directly swap faces on videos, or if it's limited to single images. Or any suggestions as to how to marry a head and a body would be greatly… Guess the model those solutions use is just too lowres, so you don't get good results with the new higher resolutions SDXL provides. And very recently, I've added a solution provided by the bright mind who came up with the Manager and other stuff we use in ComfyUI - I reckon he's a genius! - to fix the hands. Faces always have less resolution than the rest of the image. DOES anyone know where I could get a workflow that will just accept an mp4 and a face image and it does everything to convert or whatever to just output the same video with just the face swapped? Oct 13, 2023 · With the easy implementation of ComfyUI's Custom Note, you'll be able to create face swap images and animations in ComfyUI quickly. *ComfyUI Workflow* - https://drive. I was trying to keep it to a simple process, but the face swap keeps restoring the face so that it doesn't match the style at all, even if I use a different checkpoint. For general upscaling of photos go: remacri 4x upscale resize down to what you want GFPGAN sharpen (radius 1 sigma 0. It doesn't do head or person swap. youtube. ComfyUI, combined with stock or your own videos, can transform your storyboarding and video projects. If you are getting started, check out his other videos as well, they are all pretty great. com/dataleveling/ComfyUI-Reactor-WorkflowCustom NodesReActor: https://github. So I spent 30 minutes, coming up with a workflow that would fix the faces by upscaling them (Roop in Auto1111 has it by default). Face Swapper. Hi I am looking for feedback on people's experience with face swapping on video. For example, a professional tennis player pretending to be an amateur tennis player or a famous singer smurfing as an unknown singer. All packages were forked directly from the #! repositories/Github and changed only where necessary to keep it up to date with newer packages. It is meant to be a faster solution to do "face" swap. 3 in order to get rid of jaggies, unfortunately it will diminish the likeness during the Ultimate Upscale. I love that and I'm trying to find a good workflow for my image creation + face swapping. Hi guys, I try to do a few face swaps for fare well gifts. Is there any way to use a face restore model OTHER THAN cfpgan or codeformer in Comfy? There are a number of face-optimizing models on https://openmodeldb. The subject and background are rendered separately, blended and then upscaled together. I've been using a ComfyUI workflow, but I've run into issues that I haven't been able to resolve, even with ChatGPT's help. ) didn't work well. Di reactor face swap Been using the face swap for a while - all of the sudden node disappered - turns out its failing to import - anyone else had this particular issue - totally confused - have tried reinstalling it - both from github and via the node manager. In A1111 I tried Batch Face Swap extension for creating a mask for face only, but then I have to run the batch three times (first for the mask, second for inpainting with masked face and third for face only with adetailer). Anyone know of a good workflow that can faceswap videos without ruining the high quality resolution of the input video? Welcome to the unofficial ComfyUI subreddit. I'm looking for the best method to perform a face swap on video clips where the subject is facing the camera. Also the face mask seems to include part of the hair most of the time, which also gets lowres by the process. If you want to learn how to Rope Pearl for both video deep fakes and image face swapping this is the best tutorial made so far. If you want some some face likeness, try detailing the the face using impact pack, but use the old mmdet model, because the new utralytic model is realistic. https://www. The thing is, I want to use comfyui because it is easier to use. In fact, our current self-developed face swapping will still have the problem that the face does not look like the original face, but the effect will still be better than roop, as shown in the picture below. For anime look, i suggest inpainting the face afterward, but you want to experiment with the denoise level. And Also Bypass the AnimateDiff Loader model to Original Model loader in the To Basic Pipe node else It will give you Noise on the face (as AnimateDiff loader dont work on single image, you need 4 atleast maybe and facedetailer can handle only 1 ) Face Swapper. Lightning speed face swapping with all the features Upscalers Likeness modifiers Orientation management Masks: borders, differentials, auto occlusion, face parsers, text-based masking-all with strength adjustments and blending settings Mask view to evaluate masks directly Source face merging and saving Swap images or videos Feb 28, 2024 · Workflow: https://github. Jul 31, 2024 · Posted in r/comfyui by u/Automatic_Berry7474 • 3 points and 1 comment Very simple workflow. For videos of celebrities just going undercover and not doing the activity they are known for please submit to /r/UndercoverCelebs. . You can swap one face or multiple faces in a video. He is the author of the IPAdapeter Plus nodes, and has amazing videos. #!++ a lightweight Debian-based distribution featuring the Openbox and GTK+ applications. I use ControlNet to capture the actions of the characters in the original video, then feed the new character portraits with removed backgrounds into IPAdapter. Thumbnail Hello r/comfyui I made a video showing how to install and setup InstaSwap. info/ however, the only node I can find for face fixing (FaceRestoreWithModel) seems to accept just the two models mentioned above. It helps extract scenes with humans, scenes without humans, scenes without a face, scenes with a face, and faces at specific angles. com/Gourieff/comfyui-reactor-nodeVideo Helper Suite: ht When using Roop (faceswaping extension) on sdxl and even some non xl models, i discovered that the face in the resulting image was always blurry. Please share your tips, tricks, and workflows for using this software to create your AI art. I'll play around and see what I find. com/file/d/1EMAuVgPnOLXr2VFm5zW-Yh_yfFecNNFl/v Welcome to the ComfyUI Face Swap Workflow repository! Here, you'll find a collection of workflows designed for face swapping, tailored to meet various needs and preferences. CrunchBangPlusPlus (or #!++) is an effort to continue the #! environment. The video has to be an activity that the person is known for. e. Honestly, the best thing you can do is use your own face, use your own generation, or get explicit permission. Additionally, it allows you to stitch these segments back together. Roop isn't that good for anything else than a face with a closed mouth, teeth are usually out of the question. It may improve depending on your case. r/comfyui • I made a composition workflow, mostly to avoid prompt bleed. As we showed in our previous video, we demonstrated In this video, we will see how to face swap in a video using ReActor. It is less of a model and more like a "face preset". Welcome to the unofficial ComfyUI subreddit. 4 alpha 0. In face fusion it takes like 10 seconds However the one thing I cannot for the life of me get working properly is face swap. That determines how close the generated output face matches with its source. If your source image has multiple faces, you can target the desired one via an index value. Which does not happen when I use Roop. Thank you again! Nevertheless, I found that when you really wanna get rid of artifacts, you cannot run a low denoising. Yeah what I like to do with comfyui is that I crank up the weight but also don't let the IP adapter start until very late. for those with only one character, i could do face swap with ipadapter face id models, but I am wondering how i can do it with multiple characters in the picture. See, this is another big problem with IP adapter (and me) is that it's totally unclear what all it's for and what it should be used for. So that the underlying model makes the image accordingly to the prompt and the face is the last thing that is changed. At this stage, you can save the image, but I've got roop (face-swap) and face-restorer taking this image to make it more what I want. mtb node has face swap, kinda like roop, but not as good as training with lora. Achieve clear and realistic results with our advanced AI technology. I'm leaving aside the fact that inswaper128 model (which is used in roop) was designed for swapping faces quite small 128x128 everything bigger is the work of an upscaler (GAN, codeformer, etc). Just use Reactor. It only works with ReActor and maybe other nodes using the same technology. You can swap the face of one or more subjects in any image with the face of choice. Re Joker, have had pretty good results using reactor face swap, using for example Jokers face as source, then swap with whoever you want, tends to keep core joker skin colours mostly intact, but far from perfect or in control of detail. It never producec the same level of quality as facefusion. Created by: CgTopTips: With ReActor, you can easily swap the faces of one or more characters in images or videos. For the face swapping effect in the picture, I directly used the open source roop plugging. 0 you can save face models as "safetensors" files (stored in ComfyUI\models\reactor\faces) and load them into ReActor implementing different scenarios and keeping super lightweight face models of the faces you use. Video Face Swap Want to change faces in your videos? DeepSwapper's video feature makes it easy. com/watch?v=4ay8C8dAqEg. Still, gotta respect their decision, even if face-swapping already has its own ethical grey areas. Like 0. We do not encourage stolen content and unauthorized face-swap (deepfake). Just install it and see for yourself. However, i notice that if the moth is doing anything, or even that part of the face is covered by a shoulder or anything, the face swap messes up the picture a lot. Use IP Adapter for face.
lrjhm
gachq
mdsm
uuyctx
ucff
sgnio
vjys
gbflal
umh
qoakmm