Posts Tagged ‘context-aware assistive systems’

Designing a System for Playful Coached Learning in the STEM Curriculum

Korn, Oliver; Rees Adrian, Dix, Alan:

Educational Playgrounds: How Context-aware Systems Enable Playful Coached Learning

In: SmartLearn ’17 Proceedings of the 2017 ACM Workshop on Intelligent Interfaces for Ubiquitous and Smart Learning, pp. 31-37

DOI = 10.1145/3038535.3038538

Text on ResearchGate


We present the design outline of a context-aware interactive system for smart learning in the STEM curriculum (science, technology, engineering, and mathematics). It is based on a gameful design approach and enables “playful coached learning” (PCL): a learning process enriched by gamification but also close to the learner’s activities and emotional setting.

After a brief introduction on related work, we describe the technological setup, the integration of projected visual feedback and the use of object and motion recognition to interpret the learner’s actions. We explain how this combination enables rapid feedback and why this is particularly important for correct habit formation in practical skills training. In a second step, we discuss gamification methods and analyze which are best suited for the PCL system. Finally, emotion recognition, a major element of the final PCL design not yet implemented, is briefly outlined.


The paper was presented on March 13 at the SmartLearn ’17, a workshop within the ACM IUI 2017,
the 22nd Annual Meeting of the Intelligent User Interfaces Community

Gamification of Production? A Study on the Acceptance of Gamified Work Processes in the Automotive Industry

By Oliver on July 25th, 2016 in assistive technology, gamification, HCI, HMI, publications

Korn, Oliver; Muschick, Peter; Schmidt, Albrecht:

Gamification of Production? A Study on the Acceptance of Gamified Work Processes in the Automotive Industry

In: Advances in Affective and Pleasurable Design. Proceedings of the AHFE 2016 International Conference, Springer Berlin Heidelberg, New York, NY, USA, 2016
DOI = 10.1007/978-3-319-41661-8_42


In this work, we investigate how gamification can be integrated into work processes in the automotive industry. The contribution contains five parts:

(1) An introduction showing how gamification has become increasingly common, especially in education, health and the service industry.

(2) An analysis on the state of the art of gamified applications, discussing several best practices.

(3) An analysis of the special requirements for gamification in production, regarding both external norms and the mindset of workers in this domain.

(4) An overview of first approaches towards a gamification of production, focusing on solutions for impaired workers in sheltered work organizations.

(5) A study with a focus group of instructors at two large car manufacturers. Based on the presentation of three potential designs for the gamification of production, the study investigates the general acceptance of gamification in modern production and determines which design is best suited for future implementations.

Full Text


This work will be presented at the conference
AHFE ’16: 7th International Conference on Applied Human Factors and Ergonomics (July 27-31) in Orlando, FL, USA


Book chapter: Assistive Systems for the Workplace: Towards Context-Aware Assistance

By Oliver on February 10th, 2015 in assistive systems, assistive technology, HCI, HMI, publications

Korn, Oliver; Funk, Markus; Schmidt, Albrecht:
Assistive Systems for the Workplace: Towards Context-Aware Assistance

In: Assistive Technologies for Physical and Cognitive Disabilities. IGI Global, 2015. pp 121-135
DOI = 10.4018/978-1-4666-7373-1.ch006


Assist-Sys-for-the-WorkplaceRecent advances in motion recognition allow the development of Context-Aware Assistive Systems (CAAS) for industrial workplaces that go far beyond the state of the art: they can capture a user’s movement in real-time and provide adequate feedback. Thus, CAAS can address important questions, like Which part is assembled next? Where do I fasten it? Did an error occur? Did I process the part in time? These new CAAS can also make use of projectors to display the feedback within the corresponding area on the workspace (in-situ). Furthermore, the real-time analysis of work processes allows the implementation of motivating elements (gamification) into the repetitive work routines that are common in manual production.

In this chapter, the authors first describe the relevant backgrounds from industry, computer science, and psychology. They then briefly introduce a precedent implementation of CAAS and its inherent problems. The authors then provide a generic model of CAAS and finally present a revised and improved implementation.

PhD thesis: Context-Aware Assistive Systems for Augmented Work. A Framework Using Gamification and Projection

At May 21st I finished my PhD in Computer Science at the Institute for Visualization and Interactive Systems (VIS) at the University of Stuttgart. The advisors were Prof. Dr. Albrecht Schmidt from the VIS and Prof. Dr. Fillia Makedon from the Universiy of Texas Alington (UTA). The work is based on the project ASLM acquired by Prof. Dr. Thomas Hörz from the University of Applied Sciences Esslingen and was continued in the project motionEAP.

Diss-CoverThe PhD is situated in the University of Stuttgart’s SimTech Cluster and was supported by the German Federal Ministry for Economic Affairs and Energy. It is published as “Open Source” – this means you can download and distribute this work freely as long as you indicate the source:

Context-Aware Assistive Systems for Augmented Work. A Framework Using Gamification and Projection (PDF, 7.7 MB)

If you prefer a printed version you can order it at Lulu Press.


assistive systems, assistive technologies, gamification, projection, motion recognition, context-aware, game design, human computer interaction, HCI, elderly, impaired, ethics, digital factory, cyber-physical systems, CPS


While context-aware assistive systems (CAAS) have become ubiquitous in cars or smartphones, most workers in production environments still rely on their skills and expertise to make the right choices and movements. (more…)

Assisitive Augmentation at the Manual Workplace using In-Situ Projection

table_sketchFunk, Markus; Korn, Oliver; Schmidt, Albrecht:
Assisitive Augmentation at the Manual Assembly Workplace using In-Situ Projection

In: CHI ’14 Workshop on Assistive Augmentation. April 27th 2014.

Abstract [CHI-Worshop Paper]

In this paper, we argue for using in-situ projection to augment a user’s working experience. By recognizing objects on a workplace, the system is able to detect the current step within a workflow. Based on the information about position and orientation of the work-piece, speci c feedback can be given – even as a projection on top of the workpiece. So far, our work indicates that this technology is accepted by the industry. Currently, we are investigating the use of gami cation elements on the error rate. Additionally, we introduce a model for the conception of context aware assistive systems (CAAS). With our workshop participation, we want to discuss the potentials of in-situ projection at the manual workplace with the participants.