Hands-On Math: A page-based multi-touch and pen desktop for technical work and problem solving.
Robert Zeleznik, Andrew Bragdon, Ferdi Adeputra, Hsu-Sheng Ko
Robert Zeleznik is currently the director of research in the Computer Graphics Group at Brown University.
Andrew Bragdon is a PhD student studying Computer Science at Brown University.
Ferdi Adeputra is a student at Brown University studying Computer Science.
Hsu-Sheng Ko is a student at Brown University studying Computer Science.
This paper was presented at the UIST 2010.
Summary
In this paper, researchers attempted to create a new way to allow users to interact with math problems without using paper, a white board, or some kind of unintuitive computer program. Their hypothesis was that it is possible to create a device that combines the intuitive and free-flow usage of paper with the computer-aided assistance of a CAS (Computer Algebra System). In order to great an interface like this, the researchers implemented several different components.
The first they discussed was the Page Management. It allows users to quickly delete and create new pages to draw on intuitively. The next was the Panning Bar. Through a gesture, the Panning Bar allowed users to quickly sift through created pages. Folding was another useful feature. It allowed users to quickly hide or re-open large blocks of text and/or mathematical equations.
Gestures also played a big part in the interface. Under-the-rock menus were implemented where they weren't initially visible till a user wanted to perform an operation on a figure. Touch-Activated Pen Gestures (or TAP gestures) allowed the user to use the light pen in combination with their hand to signal more complex, yet intuitive, gestures. PalmPrints was created so that a user's idle hand could control various operations with the tap of a finger. The FingerPose component allowed the system to differentiate between the tip of a finger or the pad of a finger.
The Math components were also very interesting. Users can select individual numbers or even full terms. Then, using gestures, they could perform complex mathematical operations quickly like factoring by pulling numbers apart.
They tested their hypothesis and the viability of their system by allowing students from the university come in and try the system. They had them perform various tasks from creating pages to graphing an equation.
They found that most people were able to pick up the system very quickly. With some of the gestures, the participants had to be prompted to either complete an action a different way or perform the gesture differently. Once they got the hang of it, though, the interface seemed to be easy to use. The researchers confirmed their hypothesis and concluded that a more robust version of Hands-On Math would be a useful tool.
Discussion
In my opinion, the researchers were really on to something with their idea of creating a math system that combines the benefits of paper and computer assistance. They certainly had some very creative and intuitive ideas that they attempted to implement.
My main concern is the fact that they seemed to be missing some aspects that might have been helpful in the demo. First, it seemed like there were several glitches that they had to resolve during the tests. Second, perhaps a small on-screen tutorial or demo would have been helpful. It seemed like many people were trying a gesture or movement in an awkward manner. This could've been fixed by allowing them to watch some sort of demo video before they started.
I could definitely see a piece of technology like this become popular in the future. I'd love to be a user of such a system.
The first they discussed was the Page Management. It allows users to quickly delete and create new pages to draw on intuitively. The next was the Panning Bar. Through a gesture, the Panning Bar allowed users to quickly sift through created pages. Folding was another useful feature. It allowed users to quickly hide or re-open large blocks of text and/or mathematical equations.
Gestures also played a big part in the interface. Under-the-rock menus were implemented where they weren't initially visible till a user wanted to perform an operation on a figure. Touch-Activated Pen Gestures (or TAP gestures) allowed the user to use the light pen in combination with their hand to signal more complex, yet intuitive, gestures. PalmPrints was created so that a user's idle hand could control various operations with the tap of a finger. The FingerPose component allowed the system to differentiate between the tip of a finger or the pad of a finger.
The Math components were also very interesting. Users can select individual numbers or even full terms. Then, using gestures, they could perform complex mathematical operations quickly like factoring by pulling numbers apart.
They tested their hypothesis and the viability of their system by allowing students from the university come in and try the system. They had them perform various tasks from creating pages to graphing an equation.
They found that most people were able to pick up the system very quickly. With some of the gestures, the participants had to be prompted to either complete an action a different way or perform the gesture differently. Once they got the hang of it, though, the interface seemed to be easy to use. The researchers confirmed their hypothesis and concluded that a more robust version of Hands-On Math would be a useful tool.
Discussion
In my opinion, the researchers were really on to something with their idea of creating a math system that combines the benefits of paper and computer assistance. They certainly had some very creative and intuitive ideas that they attempted to implement.
My main concern is the fact that they seemed to be missing some aspects that might have been helpful in the demo. First, it seemed like there were several glitches that they had to resolve during the tests. Second, perhaps a small on-screen tutorial or demo would have been helpful. It seemed like many people were trying a gesture or movement in an awkward manner. This could've been fixed by allowing them to watch some sort of demo video before they started.
I could definitely see a piece of technology like this become popular in the future. I'd love to be a user of such a system.
No comments:
Post a Comment