Go to file

Nathan Vegdahl d538041c9d Add options to account for perspective projection. This allows properly tracking the face in 3d, rather than it just scaling up and down as its on-screen size changes.		2022-06-10 18:14:08 -07:00
.gitignore	First version of the script.	2022-05-31 09:01:24 -07:00
face_mesh_perspective.blend	Add options to account for perspective projection.	2022-06-10 18:14:08 -07:00
face_mesh.blend	Add options to account for perspective projection.	2022-06-10 18:14:08 -07:00
face_mesh.obj	Add options to account for perspective projection.	2022-06-10 18:14:08 -07:00
face_track.py	Add options to account for perspective projection.	2022-06-10 18:14:08 -07:00
LICENSE.md	Add readme and license.	2022-06-02 12:52:28 -07:00
README.md	Add readme and license.	2022-06-02 12:52:28 -07:00
shell.nix	Remove unnecessary bits from shell.nix.	2022-06-02 12:58:15 -07:00

README.md

Face Track

A very simple Python script that uses a not-at-all simple Python library to generate animated face meshes from video files.

Basic usage:

$ face_track.py path/to/video_file.mp4 path/to/output.mdd

This will create output.mdd, a NewTek MDD file. This file contains animated vertex data, which can be used to animate the face mesh in face_mesh.obj or face_mesh.blend. For example, by using the Mesh Cache modifier in Blender.

Requirements

face_track.py requires the following:

Python 3
Numpy
OpenCV and its Python bindings
Mediapipe and its Python bindings

Support

This project is a quick hack held together by ducttape and glue, and is 100% unsupported. Issue reports and contributions are welcome, but we make no promises they will be acted upon.

If you would like to further develop this, we recommend forking it into a new project.

License

All files in this project are licensed under CC0. Please see LICENSE.md for details.