Mobile gesture interfaces

Nowadays, we interact with mobile phones via 15-20 small buttons, which makes it extremely hard to reach certain functions. To write the word "hello" needs 15 button presses on an average mobile. We also need long keystrokes to find someone in the contact list with hundreds of names. Voice dialling has been available for many years, but it isn't reliable at noisy places, and we just don't feel confortable to talk to our phones when others are listening.

More and more mobile phones appear with in-built accelerometers, which may provide a new user interface. (However, these mobiles need many years to spread, the new interface would be useful for old mobiles too. We are planning to create a solution that works with any mobile.)

In our application, long keystrokes can be substituted by gestures. The accelerometer sends the signal to a MacBook nearby via Bluetooth connection. The algorithm running on the MacBook recognizes gestures and sends an imitated keystroke to the mobile phone. It works with supported Sony-Ericsson mobiles, and it is very easy to set up.

Current state (5 November): We can define gestures by recording it a few times and selecting an action. Gestures are recognized by the computer and the action is sent to the mobile. It recognizes gestures with around 97% accuracy, using 10 different gestures. Future plans include implementing the recignizer application to the mobile phone, and building external hardware that works with older mobiles too.