I'm creating a documentary about a friend of mine who was born with Muscular Dystrophy. He is 64 years old which is a medical miracle. The disease slowly kills all of your muscles. 18 years old the the average life span.
He can not move a muscle. He is on a respirator with 24/7 care. Thus, interviewing him is impossible. He can use a computer for writing and can kind of communicate with the nurse.
What I'd like to do is take his written words to the questions I ask him and create a 3d version of him talking to the camera. A stylized version..
I was thinking I would shoot another person his size against a green screen or in the location if that's possible. Have the actor read the answers to the questions. I have green screen experience.
I like the look of Stable diffusion here, https://www.youtube.com/watch?v=3wQBsFftbv8... the artifacts work creatively for me. I'm not look for toy story. The actor I'll find, I'm hoping to be a look alike. Then the 3d model can be a better rendition.
Combining the two sources, video and 3d model, using stable diffusion or another method might be very cool artistic representation of him but not exact
To do this type of process would require creating a 3d model of my friend. I can shoot him with hi-res photos. We also have many hi res photos of him when he was younger and looked more normal. The source can be determined later. I don't think creating the model from a photo is going to be an issue.
I intend to use that actor in a room sitting for the interview. I also want him to do other things like dancing, writing or drawing, throwing a ball, etc...
All of this footage would need to become a stylized version of my friend but without having MD. The 3d face/head is mapped on the actor's moving body so we don't need to animate everything.
I have an effects background with 2d with AE, shoot on 4k, edit on Davinci Resolve.
This job is already closed and no longer accepting applicants, sorry.
