• Follow us on Twitter
  • Add me on Linkedin
  • RSS

  • Home
  • Portfolio
  • Blog
  • About
  • Contact

Blog

Stuff I've been up to, and things that interest me.

Kinect Face Tracking in Unity3D

6 Comments/ in Unity3D / by Clint Hannaford
November 6, 2012

Kinect SDK FaceTracking – Unity3D – Improved mouth control from Boffswana on Vimeo.

I’ve been experimenting with the latest SDK’s from Microsoft for their Kinect for Windows device in my downtime – in particular, the new facial tracking features.

It makes for an excellent facial feature animation system – tracking things like direction and rotation, as well as tracking facial features such as eyebrows and mouth shape.

It uses Microsoft’s latest Kinect SDKs, Unity3D with a 3D head model with morph targets.

← StringAR Showcase App
Unity3D Multi-layer PBR Car Paint Shader →
Comments

6 Responses to Kinect Face Tracking in Unity3D

  1. Marcal says:
    June 5, 2013 at 12:32 pm

    Hi,

    I’m trying to do what you did with kinect facetracking and Unity3d but i’m very bad in unity3d… I have all the points of the face in unity3d but how can i “connect” the face points to a 3d model in unity3d?

    Thanks.

  2. Clint Hannaford says:
    June 5, 2013 at 11:22 pm

    I suggest jumping into the Kinect Documentation about Face Tracking and pay close attention to the Animation Units section.

    http://msdn.microsoft.com/en-us/library/jj130970.aspx

    Hint: I didn’t map points on the face to points on the model.

    (Hope that helps)

  3. Richard says:
    September 22, 2014 at 1:38 pm

    How do i get the facepoints in unity3d? any idea?

  4. Clint Hannaford says:
    September 23, 2014 at 12:07 am

    Have emailed you a quick explanation.

    Basically using OSC and passing data.

  5. Peter Divers says:
    February 10, 2015 at 9:26 pm

    Hey Clint really nice work here I saw you replied to richard with how you got the facepoints into unity3d is there any chance I could also get this email

    regards
    Pete

  6. Clint Hannaford says:
    February 10, 2015 at 10:50 pm

    Hi Peter,

    Looks like your email is incorrect.

    Contact me via website contact form and I’ll shoot you off some details.

Leave a Reply

Want to join the discussion?
Feel free to contribute!

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

*

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Categories

  • Flash/Actionscript (3)
  • Unity3D (2)

Latest Tweets

"We did a thing: https://t.co/S2FLl6xCla"
250 days ago
"RT @Supernal_aero: Take a ride with us in our Supernal cabin concept at @FIAFarnborough Airshow. We’re building new roads in the sky! #Su…"
252 days ago
"RT @GPJExpMktg: We were honored to collaborate with @GenesisUSA on their Performance of Design Events during #montereycarweek. From concept…"
over a year ago
"RT @shaunmicallef: I'm no health expert, but shouldn't he be wearing gloves? https://t.co/cu1FEmr483"
over a year ago
"RT @TheOnion: Republicans Accuse Ocasio-Cortez Of Not Being Anywhere Near Place They Told Capitol Mob She Would Be https://t.co/mF3PRUvYl1…"
over a year ago

Flickr Photos

Categories

  • Flash/Actionscript
  • Unity3D

Archive

  • March 2017
  • November 2012
  • February 2011
  • February 2010
  • July 2008
© Copyright - Clint Hannaford - Portfolio - Wordpress Theme by Kriesi.at