Home // Biomechanical User Models for Mobile Device Control based on Reinforcement Learning
Type of thesis: Masterarbeit / location: Leipzig / Status of thesis: Open theses
Smartphones are everywhere, but not all users have the same experience. While mobile apps are often tested for usability, they don’t always consider the unique hand biomechanics of individual users, such as hand size or age-related dexterity. This oversight can result in apps that work well for some, but are challenging for others.
The primary goal of this work is to create biomechanical user models that interact with interactive smartphone applications within human physiological constraints. We aim to build on existing biomechanical hand models and teach them to interact with physical but interactive devices (i.e., smartphone or tablet). These user models will be based on the theory of computational rationality. The core assumption is that users act according to what is best for them, given the constraints imposed by their limitations (cognitive limitations, motor limitations) and their experience of the task environment. Through RL, these agents will be trained to interact with touchscreens in a way that mimics human behavior. The biomechanical models will serve as a foundation, allowing us to adjust physiological characteristics of these agents, such as finger length or joint flexibility. By changing these characteristics, we can evaluate the subsequent changes in interaction behavior and usability. This approach will provide more profound insights into how different biomechanical factors influence user experience, ultimately leading to more inclusive application designs.
Please contact Patrick Ebel if you are interested in this topic or for any clarifications. Below you can find some related work that might be of interest.
Tools and Developer Suites:
Computational Interaction and Mobility
ScaDS.AI Dresden/Leipzig (Center for Scalable Data Analytics and Artificial Intelligence) is a center for Data Science, Artificial Intelligence and Big Data with locations in Dresden and Leipzig.
Chemnitzer Str. 46b,
Postal address Leipzig:
Data Science Zentrum
Internes Postfach: 212104
Copyright 2023 © ScaDS.AI Dresden/Leipzig – All rights reserved.