How to get real world coordinates (x, y, z) from a distinct object using a Kinect

Question

I have to get the real world coordinates (x, y, z) using Kinect. Actually, I want the x, y, z distance (in meters) from Kinect. I have to get these coordinates from a unique object (e.g. a little yellow box) in the scenario, colored in a distinct color.

Here you can see an example of the scenario

I want the distance (x, y, z in meters) of the yellow object in the shelf.

Note that is not required a person (skeleton) in the scenario.

First of all, I would like to know if it is possible and simple to do? So, I would appreciate if you send some links/code that could help me doing this task.

Answer 1

You would need to use both the Color Stream and the Depth Stream.

First, using the Color Stream you would need to collect an array of pixels that match the color you are looking for and then lookup the depth data from the Depth Stream for those pixels to get an average distance from the camera. That gives you the Z.

To get the X and Y you would use the math from this answer.