Video Kinect

Last but not least is video Kinect. It’s awesome to see Kinect leverage the color camera for videoconferencing, if Microsoft hadn’t included something like this, they’d be missing a huge opportunity. It’s simple too, just launch the application, and you get a view of yourself which is cropped and panned to stay centered on your face, at the left are friends online. Your video stream will stay cropped around your face whenever you’re in the field of view. 

At first, you’re given the option to video chat with other Xbox Live friends, but you can also sign in with a Live Messenger account and video chat that way as well. I initially set out to try video Kinect just between two Kinects. If you can find a friend online, inviting them to a kinect video chat looks just like an Xbox Live party or game invite - video Kinect presents itself just like a game you want your friend to join.

I dialed up my friend Brayden, and we were almost successful initially. The problem was that he had no voice. In the bottom of his video window, the speaker was greyed out, and it said Audio Off. This was confusing as there’s no readily apparent way to mute or unmute audio inside of the video Kinect interface. The problem - that party audio chat setting I mentioned earlier.

If you set this to off, you won’t get audio here, and you’ll inevitably spend lots of time scratching your head as to why. It’s confusing too - I don’t want to use the Kinect for party chat, I want to use my wireless headset. At the same time, I want to use Kinect for audio when video chatting.

Regardless, after we got it working the experience was pretty seamless. Video Kinect uses about 600 kilobits/s of bandwidth both ways, which isn’t a lot. There are come compression artifacts in the remote client’s video, but nothing out of the ordinary. My biggest complaint about video chat is that the color camera in Kinect really doesn’t seem impressive here. 

There are really only two complaints I have - first is noise and low light sensitivity. If you don’t have lots of ambient light, the camera will expose and integrate for much longer, and tends to smear a lot more than I’ve seen on other cameras unless you have room lights cranked way up. I’d rather get noise from huge gain than become a smear when all the lights aren’t on. The other problem is that the stream itself isn’t very high resolution - it’s just VGA. While the camera sensor might be higher (as has been suggested by developers working with the platform), the Kinect will only expose a VGA stream. 

The result is that video is noticeably upscaled. It’s probably the reason you can’t bring the conversation full screen. I guess that’s the other complaint I have - it’d be nice to be able to go full screen with the other party instead of have two equally sized boxes for video. 

Between two Kinects, video chat works fine. You can optionally pause your video stream or turn auto zoom and crop off. 

So what about between Kinect and Live Messenger clients? This was a bit more frustrating. The first time we tried logging into Live Messenger on the Xbox, we couldn’t see the other party on the desktop. After some troubleshooting and confusion, we decided to powercycle everything and login again, at which point we could finally see each other. Firing up a video chat like one normally would with a desktop worked fine.

Between a desktop and the Kinect, you can really see how the video stream isn’t of the highest quality. It’s tolerable, but a bit disappointing. I was chatting from a 720P webcam, and my friend noted my video quality was much improved on his end compared to the Kinect video.

The other interesting note is that when he paused video, I saw nothing but grey. One more pause and unpause, and I was stuck at a grey screen until we terminated chat and started over again. It works, however, minus those small glitches. 

I should note also that the Kinect audio quality is actually amazing, no doubt in part to that 4-microphone array and some spatial processing. It really does a great job singling out a single person and gain was kept at a comfortable level the entire time. I have to say I’m impressed with how clear audio was - there was no feedback, echo, or strange artifacts. The one thing I didn’t test was how video chat functioned between Kinect and the older Xbox Live Vision webcam, though I hear it does work and is supported.

Video chat is becoming the rage once more, the problem is that each video chat platform is isolated to such a small sect of protocols. We’ve got FaceTime and iChat if you live in the Apple ecosystem, Qik video and a few smaller ones if you live in Android land, PS3 PlayStation Eye video chat, and now Kinect Video and Live Messenger if you live in this ecosystem. I’m reminded of how SMS used to work before carriers decided that there should be inter-carrier exchanges. I’m sure we’ll get there someday, but for video chat to be more than a quick novelty, it needs to work on a common, simple platform. 

It’s hard to really complain about Kinect video chat - it’s there if you want to use it. There are better commercial alternatives that are designed specifically for this purpose, and Kinect won’t replace them, but it does make the occasional video chat possible. I find myself wanting much more resolution however, and the ability to maybe leverage video party chat with more than one other person, or even have it actually integrated into games. No doubt in time we’ll see more of that.

Kinect Apps - ESPN, Zune, Last.fm Gaming with Kinect - Dance Central
Comments Locked

72 Comments

View All Comments

  • Aloonatic - Friday, December 10, 2010 - link

    I come from the UK, where we have very expensive homes that somehow still have average room sizes that are so small that Guantánamo Bay residents would think that their lodgings were spacious loft apartments in comparison, so I was wandering if anyone has tried tinkering with the placement of Kinect?

    As every inch counts (no sniggering at the back) has anyone tried placing this on a wall mounting above and behind a TV? I'm guessing that there might be issues with the TV itself obscuring the device's field of view, but it might just work if moved high enough?

    Love the idea of Kinect, and could just about find the space as recommended on the box, but I am not sure that I have the room that Anand recommends. :(

    Oh, and will Kinect be used on the next generation xBox too? Might have to wait for Kinect 2, which will hopefully work in smaller rooms, if there ever is such a device.
  • DesktopMan - Friday, December 10, 2010 - link

    Original release Wiimote only had a 3-axis accelerometer. Motion plus didn't add a three-axis gyro until 2009. Even calling it six-axis with the gyro is stretching the definition of six-axis as it can't detect motion with constant speed unless the IR camera is pointing towards the motion bar. (Same is true for the PS3 "6-axis" controller of course. It's not six axis, it's 3-axis accelerometer and 3-axis gyro.)
  • DesktopMan - Friday, December 10, 2010 - link

    Motion bar should of course have been sensor bar. Why is there no edit button ;)
  • gvaley - Friday, December 10, 2010 - link

    There are all in all 3 (three) axes in a three dimensional world and this is exactly what we are existing in. Everything else is marketing nonsense.
  • DesktopMan - Friday, December 10, 2010 - link

    Quite. Though this is what they're actually somewhat referring to:

    http://en.wikipedia.org/wiki/Six_degrees_of_freedo...

    But neither wiimote with motion plus nor ps3 6-axis actually allows you to track all types of motion in 3 dimensions. So it's false either way :)
  • gvaley - Friday, December 10, 2010 - link

    Imagine if marketers actually respected the principals of the language, "do not use a random expression in lieu of another expression just because it's shorter" for one. "Degrees of freedom" is quite different from "axes." All robots boo.
  • landerf - Friday, December 10, 2010 - link

    Is the lag due to processing or camera frame rate? As i understand it the 360 does the processing with a cap of 10% cpu usage. So I'd then assume on the pc it could have better response time. Also can it be powered by usb 3 and or 2 on the pc? Without the need for the power plug.
  • brundleflyguy - Friday, December 10, 2010 - link

    I notice in the review it says "On the other hand, there's no possible way that Kinect would ever work in the average dorm room - you really do need 9' - 12' behind the TV to play with two people." Do you mean "in front of the TV"?

    I'm wondering because I'm using a projector. The projector is about five feet behind me on the ceiling, and the Xbox would be about four feet behind me. The wall on which I projected is about 10 feet in front of me. Would this setup work for the Kinect?

    Thanks,

    Jim
  • Gonemad - Friday, December 10, 2010 - link

    My guess is, if you are using a projector, you should put Kinect in front of you... if there is enough cable length.
    Those applications that take a picture of your face would be taking a picture of your... haircut?
    Good point! Inquiring minds...

    Now, from what I could understand... Kinect will fit right in places that have pool tables, basketball courts, large mess halls... places with plenty of room. My condo has a gym, it wouldn't be misplaced there. So much for enjoying private gaming at home. This thing would fit right in old style arcades!

    On another note, kids jumping in apartments... think about that.
    Well, the Wii had lanyards, to prevent damage to your TV. Can you attach lanyards to your limbs?

    Trolling possibilities / funny ideas:
    1- Your pedantic little brother rushes behind you, just to throw Kinetic off.
    2- Your mom learns learns how to shutdown your Xbox by talking to it, if she ever reads this article.
    3- Trash talking... with your hips. Girls know that pretty well. Do the chicken dance!
    4- Not only air guitar and air drums... air orchestra. Air violin. FTW.

    Scary thoughts:
    1a. Hackers find a way into Kinect and can record you at home.
    1b. You hack into your own Kinect and turn it into a full fledged PTZ surveillance camera.
    1c. You find out that you can build your own Kinect with industrial cameras, and it will work 20 times better... at 200 times the cost.
    1d. You find out that you can use Kinect outside a Xbox360, cutting costs in special cameras for industrial inspection (that cost above $20k easily).
    1e. You find out you could have done everything Kinect does with a regular webcam, and a range finder pulled from a parking sensor, costing you just 10 bucks.
    1f. Fighting games? Judo? Karate? Jiu-Jitsu? Tae-kwon-do? Be sure your boots are strapped tight. Roundhouse-kick your sofa's gotta hurt. Street Fighter 7?
  • SlyNine - Friday, December 10, 2010 - link

    "Your pedantic little brother " are you sure you know what that word means ? Seems to me little brothers would be less then pedantic, unless your little brother is an egg head.

Log in

Don't have an account? Sign up now