Play My Math (PMM)

Title: Play My Math (PMM)

Project duration: 01.12.2024 – December 2027

Research area: Responsible AI, Education Technology, Mathematics and Music Education

Play My Math (PMM) is an innovative EdTech solution enabling users to learn math through composing music. Users interact digitally or in a hybrid mode by photographing physical materials and math worksheets. These images are rendered by the PMM platform using AI image recognition. For students, PMM is an engaging game to write, read, and perform music using math expressions. For teachers, it integrates music into pedagogy with age-appropriate applications. PMM features a robust learning-management system (LMS) with state-of-the-art security, providing a disruptive “mathematical musician” approach for K-12 education.

Aims

The primary goal is to develop and evaluate a unique “mathematical musician” framework covering the K-12 math curriculum. By combining creative algorithms and AI image recognition, it transforms math into musical outputs.

Problems

While global demand for STEM professionals grows, students’ math performance is declining. According to 2022 PISA results, 95% of students globally cannot handle complex mathematics. Current educational approaches have failed to sufficiently improve math outcomes or student motivation. There is an urgent need for an innovative solution to reverse these negative trends and meet STEM workforce demands.

Practical example

Students use PMM as a game where they input math expressions to compose music. In a hybrid setting, students photograph physically written math worksheets or didactic materials. The AI image recognition transfers these inputs into digital models and musical outputs, allowing teachers to dynamically apply math concepts while integrating expert-validated music-therapy techniques.

Technology

PMM operates as a Software-as-a-Service (SaaS) platform powered by cloud and server infrastructure. Its core technology relies on AI-based image recognition and creative algorithms capable of analyzing photos of analog educational materials and handwritten math worksheets, transforming these mathematical inputs into musical outputs. Furthermore, it incorporates a holistic learning-management system (LMS) built with state-of-the-art security and design standards.

Outlook

Following the validation of the K-12 math curriculum, future research and development will expand the platform’s educational content into physics curricula, where students will design and build instruments from renewable materials that communicate directly with the PMM platform. Additionally, the project aims to continuously integrate new features, such as advanced sound analysis, and secure patents for its software, algorithms, and complementary didactic materials.

Publications

• Roldan-Roa, E. et al. (2024). Play My Math: First Development Cycle of an EdTech Tool Supporting the Teaching and Learning of Fractions Through Music in Algebraic Notation. In: Ferreira Mello, R., Rummel, N., Jivet, I., Pishtari, G., Ruipérez Valiente, J.A. (eds) Technology Enhanced Learning for Inclusive and Equitable Quality Education. EC-TEL 2024. Lecture Notes in Computer Science, vol 15160. Springer, Cham. https://doi.org/10.1007/978-3-031-72312-4_34
• Roldan-Roa, E. et al. (2024). Play My Math: Second Development Cycle of an EdTech Tool Supporting the Teaching and Learning of Fractions Through Music in Algebraic Notation. In: Cheng, YP., Pedaste, M., Bardone, E., Huang, YM. (eds) Innovative Technologies and Learning. ICITL 2024. Lecture Notes in Computer Science, vol 14786. Springer, Cham. https://doi.org/10.1007/978-3-031-65884-6_5
• Roa, E.R. et al. (2026). Play My Math: Design and Implementation of a Fraction Generator Tool Within a Mathematical Musician Digital Learning Platform. In: Wang, WS., Sandnes, F.E., Lai, CF., Sandtrø, T.A., Huang, YM. (eds) Innovative Technologies and Learning. ICITL 2025. Lecture Notes in Computer Science, vol 15913. Springer, Cham. https://doi.org/10.1007/978-3-031-98185-2_28
• Roa, E.R. et al. (2026). Play My Math: Design and Implementation of a Course Creator Tool Within a Mathematical Musician Digital Learning Platform. In: Tammets, K., Sosnovsky, S., Ferreira Mello, R., Pishtari, G., Nazaretsky, T. (eds) Two Decades of TEL. From Lessons Learnt to Challenges Ahead. EC-TEL 2025. Lecture Notes in Computer Science, vol 16064. Springer, Cham. https://doi.org/10.1007/978-3-032-03873-9_51

Team

Lead

• Eric Roldan Roa

Team Members with Affiliation

• Hong Tao Li
• Kevin Raud
• Quang Huy Tran

Partners

• SMILE/SEPT of Leipzig University