KeenTools has released “FaceTracker” for Blender. The software offers real-time face tracking and is available for free in the beta version.

KeenTools, known for its face tracking tools in Nuke, has released a new extension called “FaceTracker” specifically for Blender. The plugin enables real-time face tracking directly within the Blender environment and is free to use in the beta phase. This integration offers users the opportunity to efficiently integrate face mocap data into their workflow. KeenTools aims to make the use of Face-Mocap easier and more accessible by making the proven technology available to Blender users.

The “FaceTracker” functionality is seamlessly integrated into the Blender interface. Users can access the familiar controls and functions they know from other KeenTools plugins. It utilises the core technologies that KeenTools has already established in other popular 3D software solutions such as Nuke. The tool supports a wide range of use cases, from the creation of character animations to the realisation of complex VFX sequences.

A key advantage of “FaceTracker” is its real-time capability. This allows artists to see changes and adjustments immediately without having to wait for long render times. The real-time transmission of face tracking data in Blender makes it possible to react directly to feedback and thus optimise the production process. The technology behind “FaceTracker” uses algorithms based on machine learning to deliver accurate results without the need for time-consuming preparations or markings on the actor’s face.

An important aspect that users should be aware of is the beta phase of “FaceTracker”. Bugs and unforeseen problems can occur during this phase. Any new functionality should therefore be carefully tested before it is used in ongoing projects in order to avoid possible interruptions to production.

Price and licence models
KeenTools is currently offering “FaceTracker” for Blender in a beta version free of charge. This phase allows users to test the plugin and provide feedback. KeenTools has not yet announced how long this beta phase will last and what costs may be incurred after the official release. Users should keep an eye on developments on the KeenTools website to stay informed about future pricing and licence models.

Further information and detailed instructions on how to use “FaceTracker” in Blender can be found in the official KeenTools documentation. For direct updates and support, KeenTools also offers regular releases on their website.

The post KeenTools releases “FaceTracker” for Blender first appeared on DIGITAL PRODUCTION and was written by Bela Beier.

In nuce: The user Xavier (Jack), developer, animator and programmer in one, has presented the current development status of his real-time hand tracking app via Twitter. On 23 January, Xavier posted a moving image on Twitter that demonstrates what his app currently looks like in use. See below:

Good news!

I got a small grant to experiment with the creative use of real-time hand tracking in the browser.

First step, get that hand rig working with mediapipe (@tensorflow) and @threejs pic.twitter.com/RwXocbxZqJ

— Xavier (Jack) (@KMkota0) January 23, 2023

In toto: The highlight: His app should work directly in the web browser. According to Xavier, his app should still achieve good results even if the fingers being recorded are obscured by objects in the foreground of the image, for example. During development, Xavier utilised both the open source library TensorFlow , which focuses on machine learning for research and production, and Three.js, a cross-browser JavaScript library and application programming interface that can be used to create animated 3D graphics in the web browser.

Click further: To the Twitter account of the user Xavier (Jack).

Source: 80.lv ( message from Theodore McKenzie)

The post The future of real-time hand tracking? first appeared on DIGITAL PRODUCTION and was written by Patrick Poti.

A team called Akiya Research Institute VR Lab is providing insights into its motion capturing app, which should make it possible to achieve satisfactory body tracking with just two smartphone cams. The app will be available for 100 US dollars upon release or even free of charge during the limited trial phase.

It remains to be seen to what extent the app will be able to hold its own.

The post Body Tracking first appeared on DIGITAL PRODUCTION and was written by Patrick Poti.

With Faceware Live, you can create facial animations in real time through automatic tracking with live transfer to a 3D modelled face. All you need is a camera – whether a webcam, hardware from Faceware Technologies itself or another recording device.

What’s new in version 2.5

• Improved face tracking enables the software to recognise different types of faces (different skin tones, facial hair, glasses, etc.) in different lighting situations – with reduced risk of jitter.
• New animation tuning workflow that allows an animator to customise the live streaming data to change specific movements, such as a smile or eyebrow movements. These animations can be saved in profiles. It is also possible to isolate areas in order to edit only certain areas of the face.
• Animation Preview – Live 2.5 now includes an animation preview that animators can use to see how certain types of movements would look on different faces

You can read the full change log with over 20 changes here.

Learning opportunities

If you would like to learn how to use Faceware Live, you will find a series of tutorials on this page. You also have the option of downloading free training assets. These include ready-rigged faces as well as real recordings with face performance.

Prices & Availability

Faceware Live 2.5 is a free update for existing Live customers. New customers must contact support via this page. Further information on this and the products can be found here. You can also request a free trial version here.

2017 Reel from Faceware Tech

If you would like to see examples of how Faceware technologies have been used, here is the Faceware Reel 2017, including scenes from the opening of“Kingsglaive: Final Fantasy XV” by Digic Pictures, Call of Duty: Infinity Warfare and more. Have fun!

https://vimeo.com/207165649

The post Faceware Live 2.5 first appeared on DIGITAL PRODUCTION and was written by Bela Beier.