Face Swap Mac Appsunnew



My Fantasy Maker(Foto Face Swap) Editor's Review

  1. Face Swap App Mac
  2. Face Swap Mac

Foto Face Swap is an application that allows you to insert your own pictures in any background image you choose. The program includes a few backgrounds and sample faces, but you can add your own. What is great about the program is that you can select any part of the image, adjusting the area you wish to use. The app uses RefaceAI — a Generative Adversarial Network (GAN) — to swap out your face in a GIF. It’s developed by a company with the same name, and was previously used in a face swapping. Movavi Video Editor Plus is an easy-to-use and powerful face changer video editor for Mac and Windows geared toward beginner and casual users. It provides a bunch of ready-made faces including emoji, animal, mosaic, etc. So that you can replace face in video app with one click.

'My Fantasy Maker' is a software meant to help you replace people faces in the pictures or as the producer suggests: 'designed to allow users to realistically insert their face (or someone else's face) into any picture'. This is an interesting description and it seemed interesting but as soon as I opened the program I started to realize that this is not going to be what I was expecting. In my opinion for a job like this you have to work with different layers to be able to achieve a good result.
While trying to understand how this program works my disappointment begun to rise. If you do something wrong you don't have an undo button. In fact you don't have a menu at all. All its functions are listed on its interface. For many programs this could mean good news because they should be easy to use but in this case it's useless to have them at hand. The features are so few that I wasn't able to find even a color picker. How should I know to restore a part of a photo if I can't get the right color? I understand that this is not a professional tool but neither is an amateur one.
Pluses:

Face Swap App Mac

Face swap app macMacDrawbacks / flaws: Useless and expensive.
In conclusion: Programs like this make you really appreciate good programs.
version reviewed: 5.0
Oct 25th, 2019 by DFBlue
  • tutorial
  • guide
  • how to
  • deepfacelab
  • deepfakes

👀 Update 10/25/19: Added instructions for the new SAEHD model (amazing)

👽 Update 9/24/19: New post for AVATAR mode

Source and destination videos requirements

Face Swap Mac Appsunnew
  • High resolution (4k webm is best, lower than 1080p is not recommended)
  • Faces not too far from camera and unobstructed
  • Multiple angles, facial expressions
  • Brightly and evenly lit
  • Faces should somewhat match (beard, hat, hair, skin color, shape, glasses)
  • Need at least 2 mins of good quality video, interview videos work well

Downloading the software

We will use DeepFaceLab to create the deepfakes. Another software, FaceSwap is also available, and will have a separate tutorial.

Mac
  • Download DeepFaceLab
    • Make sure to pick the right build for your GPU. If you don’t have a GPU, use the CLSSE build
    • Here’s the direct link
    • In that folder, you will find some pre-compiled face-sets. Go ahead and download one of them to get started quickly (otherwise you will have to build your own face-set from videos / images)
  • The downloaded .exe will extract and install the program to the location of your choosing.
    • A workspace folder will be created. This is the folder where all the action will happen.

Extracting faces from source video

Mac
  • Name the source video data_src and place it in the workspace folder.
    • Most formats that ffmpeg supports will work
  • Run 2) extract images from video data_src
    • Use PNG (better quality)
    • FPS <= 10 that gets you at least 2000 images (4k-6k is ideal)
  • Run 4) data_src extract faces S3FD best GPU
    • Extracted faces saved to data_srcaligned.
  • Run 4.2.2) data_src sort by similar histogram
    • Groups similar detected faces together
  • Run 4.1) data_src check result
    • Delete faces that are not the right person, super blurry, cut off, upside down or sideways, or obstructed
  • Run 4.2.other) data_src util add landmarks debug images
    • New images with _debug suffix are created in data_src/aligned which allow you to see the detected facial landmarks
    • Look for faces where landmarks are misaligned and delete the _debug and original images for those
    • Once you’re done, delete all _debug images by using the search bar to filter for _debug
  • Run 4.2.6) data_src sort by final
    • Choose a target image number around 90% of your total faces

Extracting faces from destination video

You may choose to either extract from (1) the final video clip you want, or (2) one that is cut to include only the face you want to swap. If you choose 1, you may have to spend more time cleaning the extracted faces. If you choose 2 you will have to edit back the final video (and audio) after the swap.

  • Name your final video data_dst and put it in the workspace folder
  • Run 3.2) extract PNG from video data_dst FULL FPS
  • Run 5) data_dst extract faces S3FD best GPU
  • Run 5.2) data_dst sort by similar histogram
  • Run 5.1) data_dst check results
    • Delete all faces that are not the target face to swap, or are the target face but upside down or sideways. Every face that you leave in will be swapped in the final video.
  • Run 5.1) data_dst check results debug
    • Delete any faces that are not correctly aligned or missing alignment, paying special attention to the jawline. We will manually align these frames in the next step.
  • Run 5) data_dst extract faces MANUAL RE-EXTRACT DELETED RESULTS DEBUG
    • We run this step to manually align frames that we deleted in the last step. The manually aligned faces will be automatically extracted and used for converting. You must manually align frames you want converted (swapped) even if it’s a lot of work. If you fail to do so, your swap will use the original face for those frames.
    • Manual alignment instructions:
      • For each face, move your cursor around until it aligns correctly onto the face
      • If it’s not aligning, use the mouse scroll wheel / zoom to change the size of the boxes
      • When alignment is correct, hit enter
      • Go back and forth with , and .. If you don’t want to align a frame just skip it with .
      • Mouse left click will lock/unlock landmarks. You can either lock it by clicking or hitting enter.

Training

Run 6) train SAEHD

SettingValueNotes
iterations100000Or until previews are sharp with eyes and teeth details.
resolution128Increasing resolution requires significant VRAM increase
face_typef
learn_masky
optimizer_mode2 or 3Modes 2/3 place work on the gpu and system memory. For a 8gb card you can place on mode 3 and still most likely be able to do 160 res fakes with small batch size.
architecturedf
ae_dims512Reduce if less GPU memory (256)
ed_ch_dims21Reduce if less GPU memory
random_warpy
truefacen
face_style_power0Can enable if you want to morph src more to dst. But disable after 15k iterations.
bg_style_power10Turn off at 15k iterations. Styles on consume ~30% more vram so you will need to change batch size accordingly.
color_transfervariesTry all modes in the interactive converter
clipgradn
batch_size8Higher if you don't run out of memory
sort_by_yawnNo, unless you have very few src faces
random_flipy
For an NVIDIA GTX 1080 8gb GPU

Optional: History timelapse

Before converting, you can make a timelapse of the preview history (if you saved it during training). Do this only if you understand what ffmpeg is.

Convert

  • Run 7) convert SAEHD

Use the interactive converter and memorize the shortcut keys, it will speed up the process a lot.

SettingValueNotes
interactive_converteryDefinitely use the interactive converter since you can try out all the different settings before converting all the frames
modeoverlay
mask_modelearned
erode_modifier0-50If src face is bleeding outside the edge of dst face increase this to 'erode' away the src face on the outside
blur_modifier10-200The more similar the face the lower you can set erode and blur and get great results.
motion_blur0
color_transferebsTry all of them, can even use different ones for different scenes / lighting
sharpen_modebox
sharpen_amount1-3
super_resolutionRankSRGANEnhances detail, especially around the eyes
color_degrade_powern
export_alpha_masknOutputs transparent PNGs for use in post-production tools if you need it
  • While conversion is running, you can preview the final images data_dstmerged folder to make sure it’s correct. If it’s not, just close the convert window, delete /merged and start conversion again.
  • Run 8) converted to mp4
    • Bitrate of 3-8 is sufficient for most

Done 🤡

Contributions by DFBlue, PlanetOfTheFakes

Face Swap Mac

Follow us on Twitter @dfblue or Reddit u/deepfakeblue to keep up with everything that is going on in the world of deepfakes. Think Blue.