Mnemosis

Just before moving to Switzerland, I was participating in an early phase of the Mnemosis project. It’s goal was to create a markerless human motion capture system, not only capturing the movement of the bones, but the whole body, capturing skin color, texture and deformation. The ultimate application was entertainment industry, with the system capable of capturing a 3D rigged model of the actor which could be later used, by 3D animation for games, movies (2nd and 3rd plan persons), advertisement etc.

The system utilized optical measurement system with high-speed cameras and advanced image / 3D / 4D data processing algorithms as well as neural networks.

As mentioned, I participated only in the very early stage of the project, when I was responsible for creating simulation environment utilizing Autodesk 3dsmax. Thanks to plugins I have developed, the whole physical setup (cameras, synchronization) could be artificially created and used to generate images (captured by virtual cameras). With this, the team working on algorithms could start working a long time before the mechanical / electronic / optical side of the project was completed.

The video below, showing the idea behind the project, is taken from Mnemosis website (https://mnemosis.pl):

And some more demo files from the project’s YouTube: