What's the use of a motion capture system that has more than 500 cameras embedded into a two-story dome? Improve athletic performance and detect early signs of autism for starters. Ben Gruber reports.
STORY: Hanbyul Joo is working on his swing. But he's not at a baseball park, instead he's in a massive geodesic dome in the basement of a building at Carnegie Mellon University. As Joo swings more than 500 cameras capture his motion on video. Those videos are then processed to generate the most advanced 3D reconstruction ever achieved. This dome is called the Panoptic Studio and its made up of 20 panels, each of which houses 24 cameras. That coupled with an additional 30 HD cameras and depth sensors add up to ensure that the system can capture more than 100,000 different points of motion at any given moment. (SOUNDBITE) (English) HANBYUL JOO, PHD STUDENT, CARNEGIE MELLON UNIVERSITY, SAYING: "So one minute of video is about 500 gigabytes which is really huge data. To handle that data we are using 120 hard drives only for the capture." After the video is captured, it's processed using algorithms which allow the scientists to turn what are essentially 500 different video feeds into a pinpoint accurate 3D reconstruction. According to Joo, these reconstructions have a wide range of applications, the most evident being in sports where the ability to analyze and correct even the smallest motions could mean the difference between a good kick and a perfect one. (SOUNDBITE) (English) HANBYUL JOO, PHD STUDENT, CARNEGIE MELLON UNIVERSITY, SAYING: "The main purpose of this system is to analyze very interesting dynamic movements or dynamics things such as a sports players' motion. Using our system we can compare those movements so we can see how to teach the right motion to people." But even more exciting is the technology's potential in the fields of social and behavioral science. The studio's ability to capture even the most subtle movements could one day allow doctors to detect the early signs of diseases ranging from dementia to autism. That above all else, says Joo, is a reason to celebrate.