Wednesday, October 16, 2013

Intel Perceptual Computing

Do you remember Tom Cruise's Minority Report directed by Steven Spielberg? With that fancy user interface Tom used when searching people from crime database?

Well, it's here now. Not 100%, but getting closer to that.

Intel published Perceptual Computing SDK 2012. SDK is free, all you need is a 149$ camera provided by Creative Technology Ltd, a development environment like Visual Studio and a bit passion to create cool software for creating greatest user experiences ever.

With the Intel Perceptual SDK, you can detect few hand gestures like "peace" sign, hand movements, fingers, swipes, it has depth information that tells how far your hand is from the camera. It detects faces, recognizes voice commands etc. The most used development environment is Visual Studio C++, but you can do your things also with C# or Unity game development tool.

Detecting gestures and face

Some common questions I've been asked about this:
1. Is is stable?
-Pretty much, but I would not attend as a patient to a surgical operation, if the doctor is using this remotely.
And the license strongly advised not to use it in any critical systems, like car driving, controlling aeroplanes etc. 
Damn - I was just about to connect this with F-18C Hornet!

2. How much it costs?
The sdk is free, you need a 149 USD camera manufactured by Creative Labs and development environment. And some time. Not that much, if you’re familiar with Microsoft Visual Studio tools, but you’ll get started pretty fast. The cam itself looks pretty ok, it’s a lot heavier than they usually are. Maybe it tells about the quality, or just because the heavier cam stays easily at the top of the monitor(!)

3. Is there any useful apps developed for this?
Check out Intel's Perceptual Computing Challenge results from

4. What kind of data you can get from this camera?
You get actual image frame, recognized gestures, depth data, hand coordinates from high level services provided by intel SDK etc. Also you’ll get also the raw data, if you wish to do some image and gesture processing by your self. And there are some voice recognition stuff.

The camera at the top of the monitor

Here is some C# code for gesture detection. The cam recognizes few gestures like hand waving, “peace”-sign, etc. I used it to control Windows 8 desktop.

public MyPipeline(Form1 parent, PictureBox recipient)
lastProcessedBitmap = new Bitmap(640, 480);
this.recipient = recipient;
this.parent = parent;
// setting up some features
attributeProfile = new PXCMFaceAnalysis.Attribute.ProfileInfo();
// when there will be a gesture, this is called
public override void OnGesture(ref PXCMGesture.Gesture gesture)
switch (gesture.label)
case (PXCMGesture.Gesture.Label.LABEL_POSE_BIG5):
if (sameCommandDelay != null && sameCommandDelay.AddSeconds(COMMANDELAYINSECONDS) < DateTime.Now)
{ // avoid too many commands -problem…
sameCommandDelay = DateTime.Now;
case (PXCMGesture.Gesture.Label.LABEL_HAND_CIRCLE):
case (PXCMGesture.Gesture.Label.LABEL_POSE_THUMB_UP):
if (sameCommandDelay != null && sameCommandDelay.AddSeconds(COMMANDELAYINSECONDS) < DateTime.Now)
sameCommandDelay = DateTime.Now;

Depth data, c++ demo from Intel


  1. Cool! Does it work with other cameras as well?

  2. Hellou!

    Unfortunately, it works currently only with this special cam manufactured by Creative:


  3. If Intel achieve this project then it's too easy to get any criminal.
    We provide the best and reliable Move In and Move Out Cleaning Services in Piscataway NJ that release all your stress to clean out your home.

  4. Extremely useful information which you have shared here about teen patti game development company in india. This is a great way to enhance knowledge for us, and also helpful for us. Thankful to you for sharing an article like this.

  5. I must say that this is an excellent post, and I appreciate the details about Intel Perceptual Computing. You expressly make reference to one of the issues raised during the 18 Years Scale discussion. Your arguments are so strong that I want to read more of your views. However, I'm looking for the finance assignment help service right now for a school assignment. I gain from this, and I finish my duty more swiftly. The vast material on the website is useful to all students.

  6. I wrote article on Intel Perceptual Computing last month, and got quite good grades on it, actually I got some Assignment Help, I will recommend your blog to my juniors, it's pretty useful.

  7. Are you searching where to watch The $100,000 Pyramid online in UK? stop your search now and visit Watch in UK to enjoy the show now at our streaming service.

  8. Nice content! Seems like the full details are explained very well here. I would appreciate if you include more coding to this articles as it has help me to my task but need more innovations.

  9. I believe that while essay writing services may seem like a quick fix for students, it ultimately does more harm than good. Not only is it unethical to submit someone else's work as your own, but it also deprives students of the opportunity to learn and grow from the writing process. Instead of relying on essay writing services, students should seek help from teachers or tutors to improve their writing skills. Ultimately, using essay writing services only reinforces the idea that success is measured solely by grades, rather than personal growth and development.

  10. It is exciting to see that technology can be used in gaming, education, and other areas. I particularly like your assessment of the difficulties associated with designing such a sophisticated technology since it emphasises the need for collaboration and experimentation in the tech industry. Some Top Dissertation Writing Services like The Academic Papers UK are raising awareness about the importance of technology in education.

  11. Thank you for providing this information. Visit us for Getting Best Online Chemistry Tuition at Affordable prices.