http://www.leejinha.com Jinha Lee Thu, 18 Apr 2013 06:13:53 +0000 http://www.leejinha.com en http://leejinha.com/Sublimate http://leejinha.com/following/leejinha.com/Sublimate Thu, 18 Apr 2013 06:13:53 +0000 Jinha Lee 5218539 State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays Daniel Leithinger, Sean Follmer, Samuel Luescher, Alex Olwal, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. Sublimate 2013 from Tangible Media Group on Vimeo. Recent research in 3D user interfaces pushes towards immersive graphics and actuated shape displays. Our work explores the hybrid of these directions, and we introduce sublimation and deposition, as metaphors for the transitions between physical and virtual states. We discuss how digital models, handles and controls can be interacted with as virtual 3D graphics or dynamic physical shapes, and how user interfaces can rapidly and fluidly switch between those representations. To explore this space, we developed two systems that integrate actuated shape displays and augmented reality (AR) for co-located physical shapes and 3D graphics. Our spatial optical see-through display provides a single user with head-tracked stereoscopic augmentation, whereas our handheld devices enable multi-user interaction through video see-through AR. Publications <img src="http://payload145.cargocollective.com/1/2/68026/5218539/pdficon24_long.gif" width="24" height="38" width_o="24" height_o="38" src_o="http://payload145.cargocollective.com/1/2/68026/5218539/pdficon24_long_o.gif" data-mid="29338422" border="0" align="left"/> Daniel Leithinger, Sean Follmer, Samuel Luescher, Alex Olwal, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. SUBLIMATE: State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays. In Proceedings of CHI 2013 Paris, France Best Paper Honorable Mention Award, CHI 2013. State-Changing Virtual and Physical Rendering to Augment Interaction with Shape Displays Daniel Leithinger, Sean Follmer, Samuel Luescher, Alex Olwal, Akimitsu... http://leejinha.com/KinectSnip http://leejinha.com/following/leejinha.com/KinectSnip Thu, 18 Apr 2013 03:08:52 +0000 Jinha Lee 5390978 KinectSnip - Taking and Sharing Snapshot pictures with Gestural Interaction in Video Conferencing. Our project from the first Kinect SDK for Window 24 hour coding camp. Taking snapshots and sharing pictures for video-conferencing. In Collaboration with Arian Kulp, Hwajung Hong. KinectSnip - Taking and Sharing Snapshot pictures with Gestural Interaction in Video Conferencing. Our project from the first Kinect SDK for Window 24 hour coding... http://leejinha.com/See-Through-3D-Desktop http://leejinha.com/following/leejinha.com/See-Through-3D-Desktop Thu, 18 Apr 2013 03:08:42 +0000 Jinha Lee 2889590 See Through 3D Desktop is the precursor of SpaceTop (2013). Project by Jinha Lee Mentor: Cati Boulanger. My internship project at Microsoft Applied Sciences Group. done during Jun-Sep, 2011, <img src="http://payload29.cargocollective.com/1/2/68026/2889590/holobook_title.jpg" width="670" height="376" width_o="960" height_o="540" src_o="http://payload29.cargocollective.com/1/2/68026/2889590/holobook_title_o.jpg" data-mid="14728316" border="0" align="left"/> Computer scientist Ivan Sutherland once called a computer display “a looking glass into a mathematical wonderland.” and I have always aspired to walk in this wonderland to interact with those abstract beings. Despite advances in 3D sensing and display technologies, our interactions with computer desktops have remained stagnant from the form that evolved under 2D I/O modalities. See Through 3D desktop is a 3D spatial operating environment that allows the user to directly interact with his or her virtual desktop. The user can reach into the projected 3D output space with his/her hands to directly manipulate the windows. Users can casually open up the See-Through 3D Desktop and Type on the keyboard or use a trackpad as in traditional 2D operating environment. Windows or files are perceived to be placed in a 3D space between a screen and the input plane. The user can lift up his hands to reach the displayed windows and arrange them in this 3D space. A unique combination of a transparent display and 3D gesture detection algorithm collocates input space and 3D rendering without tethering or encumbering users with wearable devices. See-through 3D desktop is a term for the entire ensemble of necessary software hardware and design technological components for realizing this volumetric operating environment. * This is a research project that I proposed and developed at Microsoft Applied Sciences Group during my internship with my mentor Cati Boulanger. Many thanks go to John Weiss, Moshe Lutz, Steven Bathiche, Andy Wilson, Vivek Pradeev, Pranav Mistry, Hrvoje Benko, Tim Large, and Raj Sodhi for their valuable advice during the development of the project. Publication: <img src="http://payload29.cargocollective.com/1/2/68026/2889590/pdficon24_long.gif" width="24" height="38" width_o="24" height_o="38" src_o="http://payload29.cargocollective.com/1/2/68026/2889590/pdficon24_long_o.gif" data-mid="18182144" border="0" align="left"/> Jinha Lee, Cati Boulanger, Direct Spatial Interactions with See-Through 3D Desktop, ACM SIGGRAPH 2012 Poster, Emerging Technologies. Selected Press Cnet :Microsoft's 3D computer offers a world for your hands BGR: See-through 3D computer with gesture controls gives us a glimpse of the future [video] Geekosystem: See-Through 3D Desktop Turns Your Monitor Into a Futuristic Cyberspace Box IGN: Microsoft Shows Off Futuristic Transparent 3D Desktop - Applied Sciences Group teases us with the future of personal computing. Wired UK: Microsoft demos Kinect-powered transparent 3D desktop The Verge: Microsoft's transparent 3D desktop puts a virtual computing environment at your fingertips Mashable: Microsoft Demonstrates Mind-Blowing 3D Desktop [VIDEO] Engadget: Reddit: See Through 3D Desktop is the precursor of SpaceTop (2013). Project by Jinha Lee Mentor: Cati Boulanger. My internship project at Microsoft Applied Sciences Group.... http://leejinha.com/Lumigraphic http://leejinha.com/following/leejinha.com/Lumigraphic Thu, 18 Apr 2013 02:58:03 +0000 Jinha Lee 810462 Jinha Lee, Matt Hirsch, Henry Holtzman and Ramesh Raskar (formerly known as Lightfield Connected) The Lumigraphic is an LCD panel with an enhanced backlight, allowing it to cast directional lighting effects into the viewing space in front of the display. Car headlights jump from dark roads to your living room walls. The last rays of light from a sunset cast shadows through the trees and onto your couch. These backlight effects make the viewing experience more immersive as they demonstrate the possibilities of future high dynamic range light field displays. Lumigraphics - Matt Hirsch, Jinha Lee, Ramesh Raskar and Henry Holtzman from Jinha Lee on Vimeo. <img src="http://payload.cargocollective.com/1/2/68026/810462/logo.png" width="594" height="449" width_o="594" height_o="449" src_o="http://payload.cargocollective.com/1/2/68026/810462/logo_o.png" data-mid="3861702" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810462/_MG_0933_1.JPG" width="670" height="670" width_o="2048" height_o="2048" src_o="http://payload.cargocollective.com/1/2/68026/810462/_MG_0933_1_o.JPG" data-mid="3862861" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810462/system_3.png" width="670" height="517" width_o="1100" height_o="850" src_o="http://payload.cargocollective.com/1/2/68026/810462/system_3_o.png" data-mid="3862853" border="0" align="left"/> Jinha Lee, Matt Hirsch, Henry Holtzman and Ramesh Raskar (formerly known as Lightfield Connected) The Lumigraphic is an LCD panel with an enhanced backlight,... http://leejinha.com/GetLost http://leejinha.com/following/leejinha.com/GetLost Thu, 18 Apr 2013 02:57:58 +0000 Jinha Lee 810477 Sean Follmer, Jinha Lee, Natan Linder, and Pol Pla Urban meditation through disorientation. <img src="http://payload.cargocollective.com/1/2/68026/810477/compass.jpg" width="500" height="287" width_o="500" height_o="287" src_o="http://payload.cargocollective.com/1/2/68026/810477/compass_o.jpg" data-mid="3855894" border="0" align="left"/> We live in a hipper connected society. Get lost! is a mediatation tool that looks at disorientation as an opportunity for exploration, thus engaging people to walk outside and have a closer connection with their environment. The user sets the amount of time desired and the compass directs her on a random walkabout that ends at the same point of origin. <img src="http://payload.cargocollective.com/1/2/68026/810477/interaction.jpg" width="500" height="287" width_o="500" height_o="287" src_o="http://payload.cargocollective.com/1/2/68026/810477/interaction_o.jpg" data-mid="3855895" border="0" align="left"/> Get Lost! integrates a physical device with an android handset. It generates a random path that fits the amount of time chosen by the user by connecting to the Google Maps API, actuating the needle to guide you through. The system contains an arduino chipboard controlling a servo motor that positions the needle and a vibrator motor, a usb to bluetooth to make the connection between the android handset and the compass wireless, and is powered by rechargeable batteries. <img src="http://payload.cargocollective.com/1/2/68026/810477/Prototype_summary.jpg" width="500" height="287" width_o="500" height_o="287" src_o="http://payload.cargocollective.com/1/2/68026/810477/Prototype_summary_o.jpg" data-mid="3855896" border="0" align="left"/> To generate the new route, the user turns the time dial to set the length of the route to be taken. Get losts needle directs the user through a path chosen unknown to her, that will ultimately end at the point of origin. Sean Follmer, Jinha Lee, Natan Linder, and Pol Pla Urban meditation through disorientation. We live in a hipper connected society. Get lost! is a mediatation... http://leejinha.com/Familiar-Street http://leejinha.com/following/leejinha.com/Familiar-Street Thu, 18 Apr 2013 02:57:50 +0000 Jinha Lee 810492 Intelligent mobile software that recognizes buildings without any marker, 2008 Intern Project with Jun Rekimoto, Sony Computer Science Laboratories Familiar Street from Jinha Lee on Vimeo. What if your cell phone could read ordinary objects and buildings as if the barcode was put on everyday objects. so that your mobile device could understanding the social context? Familiar Street is an unofficial name for the research I have done in the Interaction Laboratory of Sony Computer Science Laboratories with Professor Jun Rekimoto. Detailed information about this research can not be provided on the website yet due to security of the content at Sony CSL. <img src="http://payload.cargocollective.com/1/2/68026/810492/fstreet.jpg" width="526" height="192" width_o="526" height_o="192" src_o="http://payload.cargocollective.com/1/2/68026/810492/fstreet_o.jpg" data-mid="4170025" border="0" align="left"/> In prehistoric era, People could understand the nature of surrounding environment through intuitive experience, since natural objects -- tree, stone, soil -- represent their nature by shapes, sounds, and smells. On the other hand, buildings we encounter everyday in streets thesedays do not properly represent its nature through their shapes; huge information is capsulated inside and not visually represented. Due to this, people in modern era are forced to receive visual information that lacks understandable representation, which causes people to feel isolated. In the familiar street project, we aim to build a mobile device that recognizes building; that recognizes building and artificial structures and makes their information overlapped on the images instantaneously. To achieve this goal, we decided to use "fern", a planar object detection algorithm which detects the objects based on its 2D images. We envision this system being used with large volume of picture database of streets such as Google street view, and this would enable a more intuitive access to information about our surroundings. <img src="http://payload.cargocollective.com/1/2/68026/810492/familiarstreet.jpg" width="631" height="696" width_o="631" height_o="696" src_o="http://payload.cargocollective.com/1/2/68026/810492/familiarstreet_o.jpg" data-mid="4169970" border="0" align="left"/> Intelligent mobile software that recognizes buildings without any marker, 2008 Intern Project with Jun Rekimoto, Sony Computer Science Laboratories Familiar... http://leejinha.com/Bloxels http://leejinha.com/following/leejinha.com/Bloxels Thu, 18 Apr 2013 02:57:47 +0000 Jinha Lee 810490 Glowing Blocks as Volumetric Pixels Jinha Lee, Yasuaki Kakehi, and Takeshi Naemura Glowing Blocks as Volumetric Pixels Jinha Lee, Yasuaki Kakehi, and Takeshi Naemura http://leejinha.com/Beyond http://leejinha.com/following/leejinha.com/Beyond Thu, 18 Apr 2013 02:57:42 +0000 Jinha Lee 810459 Beyond - Collapsible Input Device for 3D Direct Manipulation, 2009 Jinha Lee Surat Teerapittayanon Advisor: Hiroshi Ishii What would it be like to reach into the screen? Beyond is a collapsible input device for direct 3D manipulation. When pressed against a screen, Beyond collapses in the physical world and extends into the digital space of the screen, so that users have an illusion that they are inserting the tool into the virtual space. Beyond allows users to interact directly with 3D media without having to wear special glasses. One can select, draw, and sculpt in 3D virtual space. *This interface is a single-user interface. In some scenes/pictures, graphics is rendered from the perspective of the camera instead of the demonstrator to communicate how the scene looks from the demonstrator's point of view. <img src="http://payload.cargocollective.com/1/2/68026/810459/beoyndinteraction2_570px.png" width="570" height="270" width_o="570" height_o="270" src_o="http://payload.cargocollective.com/1/2/68026/810459/beoyndinteraction2_570px_o.png" data-mid="3862436" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810459/beyondinteraction2_570px.png" width="570" height="270" width_o="570" height_o="270" src_o="http://payload.cargocollective.com/1/2/68026/810459/beyondinteraction2_570px_o.png" data-mid="3862437" border="0" align="left"/> Beyond @ UIST 2010 in New York City from Jinha Lee on Vimeo. For more materials.. Publications <img src="http://payload.cargocollective.com/1/2/68026/810459/pdficon24_long.gif" width="24" height="38" width_o="24" height_o="38" src_o="http://payload.cargocollective.com/1/2/68026/810459/pdficon24_long_o.gif" data-mid="17248115" border="0" align="left"/>Beyond - Collapsible Input Device for 3D Direct Manipulation, Lee, J., Teerapittayanon, S., and Ishii, H., ACM UIST 2010 Demo <img src="http://payload.cargocollective.com/1/2/68026/810459/pdficon24_long.gif" width="24" height="38" width_o="24" height_o="38" src_o="http://payload.cargocollective.com/1/2/68026/810459/pdficon24_long_o.gif" data-mid="17248115" border="0" align="left"/>Beyond – Collapsible Tools and Gestures for Computational Design, Lee, J., Teerapittayanon, S., and Ishii, H., ACM CHI 2010 Work in Progress Award NetExplorateur 100 significant inventions in digital technologies in 2011. Media Coverages Designboom: jinha lee: beyond Gizmodo: Beyond - Collapsible Input Device Makemagazine: Collapsable input device for 3D manipulation Gizmowatch: The Tech Journal: InAvete Solidmack: Fast Comapny: Almost Genius: An AR Interface for Drawing in 3-D Beyond - Collapsible Input Device for 3D Direct Manipulation, 2009 Jinha Lee Surat Teerapittayanon Advisor: Hiroshi Ishii What would it be like to reach into... http://leejinha.com/ZeroN http://leejinha.com/following/leejinha.com/ZeroN Thu, 18 Apr 2013 02:57:41 +0000 Jinha Lee 810406 Levitated Interaction Element - published at ACM UIST 2011. Jinha Lee and Rehmi Post Advisor: Hiroshi Ishii <img src="http://payload.cargocollective.com/1/2/68026/810406/ZeroN_teaser_640x360.jpg" width="640" height="360" width_o="640" height_o="360" src_o="http://payload.cargocollective.com/1/2/68026/810406/ZeroN_teaser_640x360_o.jpg" data-mid="16965940" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810406/zeron_1_640.jpg" width="640" height="360" width_o="800" height_o="450" src_o="http://payload.cargocollective.com/1/2/68026/810406/zeron_1_o.jpg" data-mid="17254281" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810406/zeron_2_640.jpg" width="640" height="360" width_o="800" height_o="450" src_o="http://payload.cargocollective.com/1/2/68026/810406/zeron_2_o.jpg" data-mid="17254282" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810406/zeron_3_640.jpg" width="640" height="360" width_o="800" height_o="450" src_o="http://payload.cargocollective.com/1/2/68026/810406/zeron_3_o.jpg" data-mid="17254283" border="0" align="left"/><img src="http://payload.cargocollective.com/1/2/68026/810406/zeron_4_640.jpg" width="640" height="360" width_o="800" height_o="450" src_o="http://payload.cargocollective.com/1/2/68026/810406/zeron_4_o.jpg" data-mid="17254284" border="0" align="left"/> I think there is something fundamental behind motivations to liberate physical matter from gravity and enable control. The motivation has existed as a shared dream amongst humans for millennia. It is an idea found in mythologies, desired by alchemists, and visualized in Science Fiction movies. I have aspired to create a space where we can experience a glimpse of this future. A space where materials are free from gravitational constraints and controllable through computing technologies.ZeroN is about liberating materials from the constraints of space and time by blending the physical and digital world. ZeroN is a new physical/digital interaction element that can be levitated and moved freely by computer in a three dimensional space. Both the computer and people can move the ZeroN simultaneously. In doing so, people and computers can physically interact with one another in 3D space. Users are invited to place or move the ZeroN just as they can place any other objects on surfaces. Once levitated, ZeroN's behavior can be digitally programmed. For example, users can place the sun above physical objects to cast digital shadows, or place a planet that will start revolving based on simulated physical conditions. ZeroN can remember how it has been moved. Physical motions of people can be collected in this medium to preserve and play them back indefinitely. When the users move and release the ZeroN, it continues to float and starts to move along the same path. This allows a unique, tangible record of a user's physical presence and motion which will continue to exist. From Levitation Point to Levitation Space To realize such interactions, we developed a magnetic control system that can levitate and actuate a permanent magnet in a pre- defined 3D volume. This is combined with an optical tracking and display system that projects images on the levitating object. Conventional levitation only enables levitating an object at one point. In ZeroN Project, users can move a levitated object to anywhere in a predefined 3D space and leave it there without dropping it since the system constantly readjusts both magnetically and mechanically. It is about turning 3D space into levitating space. <img src="http://payload.cargocollective.com/1/2/68026/810406/zerontech.jpg" width="640" height="239" width_o="640" height_o="239" src_o="http://payload.cargocollective.com/1/2/68026/810406/zerontech_o.jpg" data-mid="17315449" border="0" align="left"/> Many thanks to Max Lobovsky, Ilan Moyer, Bee Vang for assistance in Mechanical Implementation, Robert Jacob, Joseph Paradiso, Pattie Maes, Ken Perlin, Jeff Lieberman, Cati Boulanger, Jean-Baptiste Labrune (advice&discussion), Kris Shin, Surat Teerapittayanon (software help). For further information contact Jinha Lee (jinhalee@media.mit.edu), or read the following paper. <img src="http://payload.cargocollective.com/1/2/68026/810406/pdficon24_long.gif" width="24" height="38" width_o="24" height_o="38" src_o="http://payload.cargocollective.com/1/2/68026/810406/pdficon24_long_o.gif" data-mid="17247710" border="0" align="left"/>Jinha Lee, Rehmi Post, and Hiroshi Ishii. 2011. ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th annual ACM UIST '11. ACM, New York, NY, USA, 327-336. Press WIRED UK Magazine: Interface floating in space FastCodesign: MIT Creates Amazing UI From Levitating Orbs ACM TechNews GIZMODO: Magnetically Levitating Balls Could Be the Future of Computer Interfaces Engadget: ZeroN slips surly bonds, re-runs your 3D gestures in mid-air MIT Video : ZeroN MIT Media Lab Labcast: ZeroN WIRED.COM Designboom: MIT media lab: zeroN Blaze: your eyes aren’t fooling you- this ball is levitating. The Verge: ZeroN magnetic levitation system can playback movements in space. Educatioedearth.net: ZeroN - MIT's Revolutionary Computer Interface Popsci: MIT's Latest User Interface Employs Gravity-Defying, Levitating Metal Orbs Gizmag: ZeroN system holds a ball wherever you place it, in mid-air ALT1040 International Business Times The Technology Cafe: Spiegel Online: Mensch-Maschine-SchnittstelleInteragieren über schwebende Kugel Hungary: index.hu (hungarian news portal) Antigravitációs kezelőfelületet mutatott be az MIT Related Project <img src="http://payload.cargocollective.com/1/2/68026/810406/seethrough3ddesktop.jpg" width="150" height="150" width_o="150" height_o="150" src_o="http://payload.cargocollective.com/1/2/68026/810406/seethrough3ddesktop_o.jpg" data-mid="17522773" border="0" align="left"/>See Through 3D Desktop: See Through 3D desktop is a 3D spatial operating environment that allows the user to directly interact with his or her virtual desktop. The user can reach into the projected 3D output space with his/her hands to directly manipulate the windows.Click to see more> <img src="http://payload.cargocollective.com/1/2/68026/810406/beyond_Square_teaser200.png" width="200" height="200" width_o="200" height_o="200" src_o="http://payload.cargocollective.com/1/2/68026/810406/beyond_Square_teaser200_o.png" data-mid="18046987" border="0" align="left"/> Beyond - Collapsible Input Device What would it be like to reach into the screen? Beyond is a collapsible input device for direct 3D manipulation. When pressed against a screen, Beyond collapses in the physical world and extends into the digital space of the screen, so that users have an illusion that they are inserting the tool into the virtual space. Beyond allows users to interact directly with 3D media without having to wear special glasses. One can select, draw, and sculpt in 3D virtual space.Click to see more> and more... Levitated Interaction Element - published at ACM UIST 2011. Jinha Lee and Rehmi Post Advisor: Hiroshi Ishii I think there is something fundamental behind... http://leejinha.com/Eone-Time-Pieces http://leejinha.com/following/leejinha.com/Eone-Time-Pieces Tue, 19 Mar 2013 20:33:43 +0000 Jinha Lee 5218567 <img src="http://payload145.cargocollective.com/1/2/68026/5218567/bradley_640.jpg" width="640" height="426" width_o="960" height_o="639" src_o="http://payload145.cargocollective.com/1/2/68026/5218567/bradley_o.jpg" data-mid="28118064" border="0" align="left"/> Eone Time Pieces website. In 2012, as a co-founder and technology lead, I helped the development of the eone time pieces by creating the first working prototype. Designed in collaboration with the visually impaired, we believe The Bradley Timepiece will prove to work better for everyone who needs to know what time it is. When we started developing The Bradley we thought about the origins of the watch, realizing that timepieces in the past have always required sight, hence the nickname "watch." Technology has moved far beyond that and the timepiece should too. The Bradley Timepiece is changing this. Who hasn't found themself in a scenario— business meetings, dark movie theaters, dinner with the in-laws—where they couldn't look at the time? After all, telling time shouldn't require sight. Eone Time Pieces website. In 2012, as a co-founder and technology lead, I helped the development of the eone time pieces by creating the first working prototype....