Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Interacting with avatar using Kinect and Unity

Tags:

c#

unity3d

kinect

I want to move the avatar based on the movement the player using kinect and Unity, are there any good tutorials?

We are using unity and Kinect interface to create a simple application. Based on the movement of the player we need to move the avatar.

We are supposed to use Unity with GAKUNITY, No OpenNI or any third party tools.

Are there any good tutorials for GakUnity with Kinect?

GAK means Gadget Accelerator Kit

We just want to move any avatar with player movement in front of kinect interface. Even help in hand movement also highly appreciated.

You can also share useful links or books regarding to unity and kinect programming.

like image 927
Raghuveer Avatar asked Apr 13 '12 10:04

Raghuveer


People also ask

How to add a Kinect avatar to Unity3D?

Open Unity3D and import the Azure Kinect SDK. Create a new scene or use one of the demo ones. Drag-and-drop the avatar in your Unity3D Project folder. Finally, drag-and-drop the .fbx file from the Projects folder to your scene. Upon creating your scene and its core elements, it’s time to connect the avatar with the tracked body. Create a C#

How to enable movement in a Kinect script?

To enable movement there's a checkbox in one of the kinect scripts I want to say either on the camera or on the character. You can compile the visual studio files and link to them from your own wrapper in Unity. The facetracking example on the asset store shows an example of implementing the kinect sdk facetracking example in Unity.

Is it possible to use Visual Studio files in Unity?

You can compile the visual studio files and link to them from your own wrapper in Unity. The facetracking example on the asset store shows an example of implementing the kinect sdk facetracking example in Unity. But it's not trivial.

What is the hierarchy of an avatar?

The hierarchy is a structure of interconnected bones that form the human skeleton. Commonly used models, such as Unity Chan, follow these principles. Your models should follow the exact same hierarchy, too. Opening the avatar file in the Editor, its joint/bone structure would look like this: You can read more about configuring your avatar here .


3 Answers

Custom Kinect Gesture Recognition using OpenNI and Unity3D
kinect.dashhacks.com

A tipster has tipped a lil tipple my way in the form of custom gesture recognition for the Kinect using OpenNI and Unity 3D. What this allows you to do is create you own custom gesture that are recognized by the kinect through the software interface.


Unity and Kinect tutorial
nightmarekitty.com

For this chapter, we are going to be using a very popular game engine called Unity. By integrating OpenNI, Nite and Sensor Kinect into Unity we will control a 3d character and multiple user interfaces. After we cover the main Components, we will build an example of each from the bottom up.


Kinect Wrapper Example Project
wiki.etc.cmu.edu

This scene shows you how a skeleton is generated / tracked by placing spheres at each of the bones tracked by the Kinect, and how to use kinect to control your model. Use this to get a feel for what the Kinect is capable of. It also shows you how to prepare your GameObjects

like image 191
John Isaiah Carmona Avatar answered Oct 22 '22 00:10

John Isaiah Carmona


I am not familiar with Unity 3d,but you can try using kinect with XNA. At the latest version of Kinect for windows SDK 1.5 and Developer Tookit 1.5.1,there is a sample demonstrating how to interact with 3d avatar using Kinect and XNA,you can find more information on http://msdn.microsoft.com/en-us/library/jj131041

like image 45
yangecnu Avatar answered Oct 21 '22 23:10

yangecnu


I have no idea about GAKUNity, but you can use zigfu plugin for unity3d and do your project. It has got sample codes and character which you can use for reference, and the sample codes are commented nicely .

You can just import your bone, drag your bones on the zigskeleton script . just read through th zig skeleton script and you will understand the function and structures they are using.

And you can even refer the MEET THE KINECT book, they have explained about using zigfu in unity .

like image 1
Pruthvi P Avatar answered Oct 21 '22 22:10

Pruthvi P