Three-dimensional video conferencing seems like something only found in sci-fi movies, but a research team from Queen’s University’s Human Media Lab has designed a life-sized working model made from a few readily available electronic components. The team, led by Professor Roel Vertegaal, designed the 3D video conferencing pod called ‘Telehuman’ around Microsoft’s Kinect sensor device.

The design uses an opaque acrylic cylinder that’s approximately 5.6 feet tall with a diameter of 29.5 inches mounted on a plywood platform as the Telehuman’s display screen. Six Kinect sensors are arranged in a circular fashion on top of the acrylic screen which is used to capture a person’s image from the front, back , and both sides to create a real-time 3D image at 30 fps. Located in the bottom of the screen’s base is a DepthQ projector (in conjunction with a Nvidia 3D Vision kit) that’s aimed upward toward a convex mirror which allows the projected image, at a resolution of 720p, of the other user to cover the entire screen.

The images captured from the Kindest sensors are sent to a series of PC’s (1 for every 2 Kindest sensors) to process the image data as well as distance and position relative to the screen and broadcasts the result over a gigabit LAN connection to the corresponding party in conference. The Telehuman is  based off of Human Media Lab’s BodiPod 3D imaging system that allows researchers a cut-away 3D view of the human body. However, unlike the Telehuman, the BodiPod has a gestural interface allowing users to manipulate images of human anatomy. An example being using a ‘peel’ gesture to remove an imaged layer of anatomy of what’s displayed on the screen while other gestures could be used to focus on the depth of the anatomical image with ‘proximity-based slicing’. Both systems share the same technological base and prove that 3D real-time imaging systems aren’t just an aspect of science fiction any longer.

Cabe

http://twitter.com/Cabe_e14

Have you ever wanted to design your own robot but were unsure where to start? Fear-not friend, Microsoft has recently released a new iteration of its robot design software called ‘Robotics Developer Studio 4’. The software is centered heavily around the inclusion of Microsoft’s Kinect sensor for the home hobbyist’s robot designs. Included are SDK’s for both real and simulated Kinect sensors with support for all of its functions, the skeletal tracking feature, depth sensing, and microphone arrays.

RDS4 also takes advantage of Microsoft’s Visual Programming Language (VPL) that lets designers ‘drag and drop’ objects displayed in a virtual environment which then can be used to test your robot in any setting such as your virtual home and anywhere else you can think of. More advanced users can still program in C# through Visual Studio and Visual Studio Express. The software also incorporates Concurrency and Coordination Runtime (CCR), accessed through .NET Framework, in conjunction with a Decentralized Software Service (DSS) Manifest Editor (Decentralized Software Services web-based compiler) that makes writing robot applications much simpler. They want it to be easy.

With that in mind, Microsoft has also added tutorials for just about every aspect of RDS4 as well as sample code to help get you started in the world of robotics. With that said, Paralax Inc. has released a robotic hardware kit (for $1,249 US) based off of Microsoft’s ‘EDDIE’ robot design that takes advantage of RDS4 for those who are interested. Robotics Developer Studio 4 is available now for free and runs on Windows 7 and the upcoming Windows 8.

Parallax EDDIE

See more about robotic innovations in element14's Robotics Group.

Cabe

http://twitter.com/Cabe_e14

SoftKinetic is looking to change the way people interact with the digital world. They have recently unveiled a new depth sensor, 8 years in the making, that offers end-to-end 3D gesture recognition. It has no problem working in the dark or dim-light situations and works in confined areas better than its competition. Look at you, Microsoft Kinect. I originally saw this tech at CES 2012.

The sensor uses a patented time-of-flight(TOF) technology that can provide 3D distance data at up to 60 fps. The sensor seemed much more responsive that the Kinect, almost zero lag. It works by an infrared light, which is projected into a room, and the sensor measures the time period that it takes to return. It can precisely detect objects in the room and then process the distance data into a sharp 3D RGB image. In addition, the data include depth maps and grey-scale separation for software purposes. It can operate between a range of 1.5 to 4.5 meters and includes a dual microphone feature for audio input.

The technology will cost around $500 to buy a development kit for your own projects, but SoftKinetic is also looking to integrate these into new TVs and possibly laptops. However, they will have to size them down first before they could make the smooth transition into consumer technologies. At the moment, the SDK for the DepthSense system is available at their website, iisu SDK for Windows or Linux.

Cabe

http://twitter.com/Cabe_e14

People sure love their pets. Some even go out of their way to comfort them when not at home, like hiring a sitter or taking them to a doggy day-spa. Others, like Microsoft engineer Jordan Correa, build interactive robots to keep tabs on them while away. Called Darwinbot (named after his dog Darwin), Jordan started the build using the iRobot Create, a cleaning robot at its heart. Now with version 2, Correa moved on to the Parallax Eddie platform, which used the 8-core Propeller microcontroller, Kinect sensor, and a hand full of additional features missing from the iRobot Create.

As a Microsoft employee, it is not surprising that the MS Robotics Developer Studio was used for the dog-interaction software. The robot is equipped with a ‘ball-launcher,’ that can hurl the ball about 15 feet, along with a Lynxmotion robotic arm that is used for ball retrieval. Included on the robot is a ‘hopper’ that dispenses treats on command (why Darwin simply doesn’t raid the dispenser is currently unknown). Housed on the front of the robot is an array of cameras that include a webcam that can pan and tilt along with a Kinect that’s used for obstacle detection and avoidance. Also included is a Slate PC that runs Skype, so Darwin can see and hear his master who controls the robot via an Xbox 360 controller.

It is assured that promoting Microsoft like this is the only way Correa can get away with a telepresence, play with his dog, session while on the clock. Will his dog love the robot more over time?

See more robots in the element14 Robotics Group.

Cabe

http://twitter.com/Cabe_e14

Kinect for Windows v1.0 (via Microsoft)

The Microsoft Kinect is a widely popular object tracking camera system first released for the XBOX 360. It allows users to interface with games and menus without operating a controller. After its release, the "hacker" community quickly adapted the tech for use with computers. Simple tracking programs and art based developments soon followed. Due to the popularity, Microsoft started the Kinect Accelerator program, offering large cash prizes for further development with the Kinect.

Flash forward to today, Microsoft has released the Kinect for Windows version 1.0. Included in the release is a SDK and runtime environments. Most notable in the release is a "near-mode" for the new Kinect hardware, allowing tracking to be clear at 40 cm (approx 15 inches). Having one on a desk is completely feasible now. (With the XBOX setup, users have to be several meters away for accurate tracking.)

Improved tracking, controlling up to four Kinect sensors, improved speech recognition, and a driver update system is included in the release of v1 hardware and software. The SDK is meant for companies looking to develop software or other products for the Kinect, but it is available for anyone to download at the moment. Applications written in C++, C#, or Visual Basic in MS Visual Studios 2010 is supported right out of the box.

The Kinect for Windows hardware is planned to cost $250, and it is available now. An educational price of $150 will happen later this year. I sense a mad rush to be the first to market various control interfaces using Kinect. Hop in the dev-train now, or read more about the release at the Kinect for Windows page.

Cabe

http://twitter.com/Cabe_e14

How will we look using Kinect for Windows? Find out in this week's Engineering On Friday.

More Kinect based projects:

Holodesk, the virtual 3D desktop

Control your robot with Kinect

Robotic shopping cart, follows its user around

Control the web and Windows 7 with Kinect

Kinect and Surface, virtual physics engine

Advanced robot tech for the masses

Upgraded humanoid service robot, buy it now

Autonomous robot plays catch

Surgeons of the future might use robotic nurses

My pictures were too far away. This one is via Microsoft @ CES 2012

CES (Consumer Electronic Show) 2012 started off a little bit different to say the least. It was done in a sort of late night talk show setting with Ryan Seacrest interviewing Microsoft CEO Steve Ballmer, and they even brought guests on stage for product demos.

So what does the software giant Microsoft have in store for 2012? First and foremost was Derek Snyder’s (Microsoft product manager) introduction of this year’s Windows phones which failed miserably when trying the voice-to-text transcription. (Like I mention here, the error is sure to be noticed.) A moment later, the problem was solved and a myriad of mobile devices were introduced that will feature the new Windows mobile OS such as Nokia’s Lumina 710 (for T-Mobile) and Lumina 900 (for AT&T). HTC also made an appearance with their Titan 2 phone which boasts a 1.5GHz Snapdragon S2 processor and a 16 megapixel camera.  (Still no new Sprint Windows Phones)

Ballmer then talked about the upcoming Windows 8 OS that can be used not only on your PC but with mobile devices as well. The beta, he says, will be available in late February for the general public. Other guests showed there perspective wares in the ultra-thin notebook lines that feature Windows 7 (more on those later). Also announced was the transition of the Kinect over to the PC with Ballmer adding that Microsoft is working with over 200 companies to ‘revolutionize’ (Their words) the Kinect in new ways. (A smaller Kinect with a larger viewing angle, for the bubble burster)

Also touched on was ‘Metro’, Microsoft’s Windows Phone 7 interface, which will ported over to Windows 8 for the PC and can be viewed early if you participate in the Beta. Towards the end of the keynote was the typical numbers up-date of how many Kinect units were sold and how Windows 7 is the fastest selling OS for the company along with facts about Bing, Office 2010, the acquisition of Skype and so forth. At the end of the keynote it was ‘hinted’ that this year will be the last for Microsoft at CES. If so, this brings an end to over 14 years of keynote speeches from the software giant. All in all, a fitting start to this year’s Consumer Electronic Show!

Despite what analysts are saying, jobs for engineers are still a bit scarce. I know a few who have been out of the market for years. Now it is time for these people to "engineer" their way out of the financial hole. Microsoft (MS) is here to help.

With the new "Kinect Accelerator" program, ten groups of people are going to be chosen to build something innovative with the Kinect. Any type of project is acceptable, from gaming to surgery. The ten groups will receive $20,000 USD, various dev-kits, and as much technical help MS can offer. The deadline for the application process is January 25th, 2012. Upon the start of the contest, all the teams will only have 3 months to complete their work. Most projects take longer than that, but financially hungry people do amazing things.

One possible contender comes from two students at the University of West Bohemia. Their SandyStation interactive sandbox uses the Kinect to create an alterable animated image on a 3D surface. Make piles and have a lush green mountain, put a hole in it and have a volcano that flows lava. The system can make pools of water and flow that virtual liquid down paths made by the user in real time. Sounds like this will provide minutes of fun.

However, the system looks like a great way to plan landscapes, map battlefields with troop movement, and demonstrate physics in motion. I am sure we will see this at all our local tech museums in the near future. I bet their Kinect Accelerator application has already been filed.

Cabe

http://twitter.com/Cabe_e14

More Kinect based projects:

Holodesk, the virtual 3D desktop

Control your robot with Kinect

Robotic shopping cart, follows its user around

Control the web and Windows 7 with Kinect

Kinect and Surface, virtual physics engine

Advanced robot tech for the masses

Upgraded humanoid service robot, buy it now

Autonomous robot plays catch

Surgeons of the future might use robotic nurses

Today at E3 Microsoft announced a had full of new updates and additional features using the Kinect accessory for the XBOX 360. Some of the features include motion and voice navigation through the menus. Voice search is also mentioned. Another fun feature, scanning real life objects and placing them in the virtual space. Fun and all, but another new, non-Microsoft,  Kinect usage outshines all these latest.

Luis de Matos from the University of Beira Interior has used the Kinect as the central sensor for a robotic shopping cart that will follow its user anywhere. Matos gears the concept, he calls wi-GO, to aid the disabled in the task of shopping. In the video, Matos shows how difficult grocery shopping can be for those in wheel chairs. The second half shows the wi-GO, cart, following the same person around just a few feet back at the ready. The Kinect provides the sensors for tracking, and a laptop handles the motion control and processing.  The wi-GO has the potential to increase the quality of life for the disabled, elderly, and pregnant women. I hope Microsoft takes notice after all of E3's excitement.

Eavesdropper