Gathering Intel

A few months ago I posted about the Kinect device from Microsoft. Kinect, since its launch in November, has sold over 2.5 million units in less than 30 days. This makes it the fastest adopted consumer electronic device ever, surpassing the recent title holder the iPad. Now what is really impressing me is how the hacking community has gone wild with the device and I recommend visiting KinectHacks.net to see what I mean.

The technology behind the Kinect intrigues me. I know very little about 3D depth sensors and RGB cameras, so to learn more I decided to visit the Intel Lab Seattle that has been doing research in this area long before Kinect was released.

Located by the University of Washington, Intel Lab Seattle is a Center of Excellence in Context-Aware Sensor-Driven Systems. Interdisciplinary projects and an emphasis on prototyping novel systems and user evaluation drive its agenda. Led by Director Dieter Fox, the research staff are recognized experts across a range of topics from sensing and wireless systems, through robotics and computer vision, to human-computer interaction. I got the opportunity to meet with Dieter and learn more first hand about the lab and the research they are conducting there.



As stated in the video, PrimeSense is the maker of the depth cameras that the Intel team currently works with and the hardware that is in Kinect.



A nice writeup on how the PrimeSense sensor works can be found at the MirrorImage blog. Depth cameras provide a stream of color images and depth per pixel. The sensors can be used to generate 3D maps of indoor environments. The Intel Lab team has used this to create some 3D maps built in their lab.



What you see is not the raw data collected by the camera, but a walk through the model generated by their mapping technique. As can be seen in the video, the maps are not complete. They were generated by simply carrying a depth camera through the lab in one pass and aligning the data into a globally consistent model using statistical estimation techniques.

3D indoor models could be used to automatically generate architectural drawings, allow virtual fly-throughs for real estate, or remodeling and furniture shopping by inserting 3D furniture models into the map. Being someone that works with the digital built environment, this could come in very handy.

Many thanks to Dieter and the staff at the Intel Lab Seattle for the lesson in depth sensors. With the work this group is doing in this domain and other, I am sure I will find myself back in Seattle to gather more intel.

Comments

Post a Comment

Popular posts from this blog

A quick response to QR and Data Matrix code.

Image
So lately I have been seeing more Data Matrix and QR code around. Data Matrix and QR code is a 2D barcode consisting of black and white "cells" or modules arranged in either a square or rectangular pattern that represent encoded information. Unlike augmented reality markers, data matrix code only represents text or raw data. Data Matrix (DM) symbols are rectangular in shape and usually square, they are made of cells: little elements that represent bits . Depending on the situation a "light" module is a 0 and a "dark" module is a 1, or vice versa. Every Data Matrix is composed of two solid adjacent borders in an "L" shape (called the "finder pattern") and two other borders consisting of alternating dark and light "cells" or modules (called the "timing pattern"). Within these borders are rows and columns of cells encoding information. The finder pattern is used to locate and orient the symbol while the timing pattern p
Read more

Full of AWE at Augmented World Expo 2017

Image
Augmented World Event 2017 There are not many event series I can say I have attended since day one but the Augmented World Expo , formerly the Augmented Reality Event, is one I can put in that category. This was the 8th annual event and no doubt it sure has come a long way since that first event I visited in 2010 . AWE is the largest event focused on the commercial side of AR, VR, and includes wearables. “AR and VR are bringing superpowers to the people and this year we are on a mission to highlight how to use these Superpowers to Change the World. This year’s conference and expo will showcase speakers, startups and organizations who are using AR & VR to drive economic growth, encourage empathy and collaboration, democratize healthcare and education, and promote sustainability in the world.” - event website This year was the best year for AWE in my opinion and their biggest ever. The event brought in 4,700 attendees, 351 speakers, and 212 exhibitors from all over t
Read more

Artificial Intelligence & Robots

Image
Artificial intelligence (AI) is the intelligence of machines and the branch of computer science that aims to create it. Released during the Game Developers Conference, the now viral “Kara” concept video made by the Paris-based Quantic Dream, developers of the Heavy Rain game, is a look at the future of gaming, using full-body motion capture and a new computer-graphics engine. It is running in real time on Sony’s PlayStation 3 platform. The video is thought provoking as a robot comes to life and is quickly scared by the idea of how precious that can be. What I find interesting is that this type of artificial intelligence is not too far in the future thanks to friends like David Hanson of Hanson Robotics . I got the chance to hang out with David for several days during a trip last year to New Zealand and I was amazed by his work and the state of the A.I. industry. While I have some reservations about 'smart machines' thanks to Hollywood (Terminator, Matrix), David assures me th
Read more