Human decisions are increasingly supported by decision support systems (DSS). Humans are required to remain “on the loop,” by monitoring and approving/rejecting machine recommendations. However, use of DSS can lead to overreliance on machines, reducing human oversight. This paper proposes “reflection machines” (RM) to increase meaningful human control. An RM provides a medical expert not with suggestions for a decision, but with questions that stimulate reflection about decisions. It can refer to data points or suggest counterarguments that are less compatible with the planned decision. RMs think against the proposed decision in order to increase human resistance against automation complacency. Building on preliminary research, this paper will (1) make a case for deriving a set of design requirements for RMs from EU regulations, (2) suggest a way how RMs could support decision-making, (3) describe the possibility of how a prototype of an RM could apply to the medical domain of chronic low back pain, and (4) highlight the importance of exploring an RM’s functionality and the experiences of users working with it.

Colour is widely utilised as a visual coding system in visual search, but its application under vibration conditions (e.g., in various vehicles) has not been fully explored. This study was designed to examine the effect of colour combinations on performance of visual search tasks conducted in vibration conditions. Forty-eight university students participated in an experiment where they were required to identify target type and location under 24 colour combinations (half in negative polarity and half in positive polarity) and three vibration conditions (static, low, and high). The findings showed that vibration did not significantly affect performance, perceptions, or physiological aspects. Colour combination significantly affected response time, and the participants preferred colour combinations that had the potential to produce better performance. Colour combinations with negative polarity (e.g., yellow on black and white on black) are recommended for presenting search interfaces. These findings are of importance in human–computer interface designs for information display under vibration conditions.

In various scenarios, the motion of a tracked object, for example, a pointing apparatus, pedestrian, animal, vehicle, and others, is driven by achieving a premeditated goal such as reaching a destination. This is albeit the various possible trajectories to this endpoint. This paper presents a generic Bayesian framework that utilizes stochastic models that can capture the influence of intent (viz., destination) on the object behavior. It leads to simple algorithms to infer, as early as possible, the intended endpoint from noisy sensory observations, with relatively low computational and training data requirements. This framework is introduced in the context of the novel predictive touch technology for intelligent user interfaces and touchless interactions. It can determine, early in the interaction task or pointing gesture, the interface item the user intends to select on the display (e.g., touchscreen) and accordingly simplify as well as expedite the selection task. This is shown to significantly improve the usability of displays in vehicles, especially under the influence of perturbations due to road and driving conditions, and enable intuitive contact-free interactions. Data collected in instrumented vehicles are shown to demonstrate the effectiveness of the proposed intent prediction approach.

Recent improvements in virtual reality (VR) allow for the representation of authentic environments and multiple users in a shared complex virtual world in real time. These advances have fostered clinical applications including in psychiatry. However, although VR is already used in clinical settings to help people with mental disorders (e.g., exposure therapy), the related ethical issues require greater attention. Based on a thematic literature search the authors identified five themes that raise ethical concerns related to the clinical use of VR: (1) reality and its representation, (2) autonomy, (3) privacy, (4) self-diagnosis and self-treatment, and (5) expectation bias. Reality and its representation is a theme that lies at the heart of VR, but is also of specific significance in a clinical context when perceptions of reality are concerned, for example, during psychosis. Closely associated is the autonomy of VR users. Although autonomy is a much-considered topic in biomedical ethics, it has not been sufficiently discussed when it comes to applications of VR in psychiatry. In this review, the authors address the different themes and recommend the development of an ethical framework for the clinical use of VR.

This paper sheds light on the new possibilities for user research activities facilitated by access to makerspaces. We present four case studies of user research conducted in two university-based makerspaces as examples of makerspace-driven user research. Further, by comparing the cases to three classical user research activities, namely observation, prototyping, and user journey mapping, we highlight the main aspects of this new context of user research. We find that accessibility to makerspaces enables user researchers to build low-fidelity yet high-functionality prototypes for exploring users’ preferences and motivations in controlled and repeatable ways. These prototypes fall into the category of experience prototypes, but they have greater functionality than the prototypes previously used in this field. Thus, a user researcher can explore a topic more systematically and in a more hypothesis-driven manner. In summary, this study encourages stakeholders in the early stages of product development to consider a makerspace as a resource for user-related requirement elicitation rather than for only specific product iteration.

Detecting and recognizing objects is one of the most important uses of vision systems in nature and is consequently highly evolved. This paper aims to accurately detect an object using its shape and color information from a complex background. In particular, we evaluated our algorithm to detect 19 different integrated circuits (IC) from 10 different printed circuit boards (PCB) of different colors. We have compared three different shape descriptors for four different color space models. We have evaluated shape detection algorithms in different lighting conditions (indoor, outdoor, and controlled light source) to find suitable illumination for image acquisition. We undertook statistical hypothesis testing to find the effect of color space models and shape descriptors on the accuracy, false positive and false negative rates. While measuring accuracy, we have noted that L*a*b* color space is significantly worse, and the best result is obtained in YCbCr color space using bounding box shape descriptors for 2500 Lux using LED.

Conventional tests with written information used for the evaluation of sign language (SL) comprehension introduce distortions due to the translation process. This fact affects the results and conclusions drawn and, for that reason, it is necessary to design and implement the same language interpreter-independent evaluation tools. Novel web technologies facilitate the design of web interfaces that support online, multiple-choice questionnaires, while exploiting the storage of tracking data as a source of information about user interaction. This paper proposes an online, multiple-choice sign language questionnaire based on an intuitive methodology. It helps users to complete tests and automatically generates accurate, statistical results using the information and data obtained in the process. The proposed system presents SL videos and enables user interaction, fulfilling the requirements that SL interpretation is not able to cover. The questionnaire feeds a remote database with the user answers and powers the automatic creation of data for analytics. Several metrics, including time elapsed, are used to assess the usability of the SL questionnaire, defining the goals of the predictive models. These predictions are based on machine learning models, with the demographic data of the user as features for estimating the usability of the system. This questionnaire reduces costs and time in terms of interpreter dedication, as well as widening the amount of data collected while employing user native language. The validity of this tool was demonstrated in two different use cases.

Accessibility in immersive media is a relevant research topic, still in its infancy. This article explores the appropriateness of two rendering modes (fixed-positioned and always-visible) and two guiding methods (arrows and auto-positioning) for subtitles in 360° video. All considered conditions have been implemented and integrated in an end-to-end platform (from production to consumption) for their validation and evaluation. A pilot study with end users has been conducted with the goals of determining the preferred options by users, the options that result in a higher presence, and of gathering extra valuable feedback from the end users. The obtained results reflect that, for the considered 360° content types, always-visible subtitles were more preferred by end users and received better results in the presence questionnaire than the fixed-positioned subtitles. Regarding guiding methods, participants preferred arrows over auto-positioning because arrows were considered more intuitive and easier to follow and reported better results in the presence questionnaire.

Nowadays, the use of virtual reality/virtual acoustics (VR/VA) in archaeology for rendering lost buildings is an important topic in the cultural heritage field. Moreover, the addition of additional senses apart from the sight increases the feeling of immersion in virtual environments. The aim of this paper is to show the interaction work developed in a VA system, based on Unity and FMOD, the graphical and acoustical reconstruction of an ancient building and the development of a VR goggles with headphones to render 3D audio and video interactively. This system has been implemented to render auralizations in a binaural system and has been applied to the renderization of an old and lost theatre in València (Spain). The first building of theatre was built in the 16th century, and was rebuilt several times until the 18th century. The auralization of several theatrical excerpts of different Spanish authors of that time is also presented. The integrated system has been subjectively evaluated, obtaining very satisfactory results.

In the present modern age, a robot works like human and is controlled in such a manner that its movements should not create hindrance in human activities. This characteristic involves gesture feat and gesture recognition. This article is aimed to describe the developments in algorithms devised for obstacle avoidance in robot navigation which can open a new horizon for advancement in businesses. For this purpose, our study is focused on gesture recognition to mean socio-technological implication. Literature review on this issue reveals that movement of robots can be made efficient by introducing gesture-based collision avoidance techniques. Experimental results illustrated a high level of robustness and usability of the Gesture recognition (GR) system. The overall error rate is almost 10%. In our subjective judgment, we assume that GR system is very well-suited to instruct a mobile service robot to change its path on the instruction of human.

Speech- and gesture-based interfaces for computer-aided design (CAD) modeling must employ vocabulary suitable for target professional groups. We conducted an experiment with 40 participants from architecture and engineering backgrounds to elicit their speech preferences for four CAD manipulation tasks: Scale, Rotate, Copy, and Move. We compiled speech command terms used by participants and analyzed verbalizations based on three analytic themes: the exactness of descriptions, the granularity of descriptions, and the use of CAD legacy terms. We found that participants from both groups used precise and vague expressions in their verbalizations and used a median of three parameters in their verbalizations. Architects used CAD legacy terms more than Engineers in the tasks Scale and Rotate. Based on these findings, we give recommendations for the design of speech- and gesture-based interface for conceptual CAD modeling.

To be useful for architects and related designers searching for creative, expressive forms, performance-based digital tools must generate a diverse range of design solutions. This gives the designer flexibility to choose from a number of high-performing designs based on aesthetic preferences or other priorities. However, there is no single established method for measuring diversity in the context of computational design, especially in the field of architecture. This paper explores different metrics for quantifying diversity in parametric design, which is an increasingly common digital approach to early-stage exploration, and tests how human users perceive these diversity measurements. It first provides a review of existing methodologies for measuring diversity and describes how they can be adapted for parametrically formulated design spaces. This paper then tests how these different metrics align with human perception of design diversity through an online visual survey. Finally, it offers a quantitative comparison between the different methods and a discussion of their attributes and potential applications. In general, the comparison indicates that at the level of diversity difference that becomes visually meaningful to humans, the measurable difference between metrics is small. This paper informs future researchers, developers, and designers about the measurement of diversity in parametric design, and can stimulate further studies into the perception of diversity within sets of design options, as well as new design methodologies that combine architectural novelty and performance.

This position paper presents a new approach based on my experience in the evolution of human-centered design (HCD) during four decades, and how it has struggled to become a discipline in its own right in complex socio-technical systems’ creation, development and operations. The 20th century saw tremendous industrial developments based on tangible materials that were transformed and assembled to make washing machines, cars, aircraft and power plants; during its last three decades, electronics and software were incrementally added to hardware machines. Operationalization issues moved from hardware to software, making automation and user interfaces central issues. From the beginning of the 21st century, we began to do the exact opposite! Currently, we typically start a project by designing and developing technology on computers, using software only, which is later transformed into hardware (and software). I denote this shift, the ‘socio-technical inversion’. Operationalization issues are moving from software to hardware, making tangibility a central issue. Three useful conceptual models are presented: the SFAC (Structure/Function versus Abstract/Concrete) model; the NAIR (Natural/Artificial versus Cognitive/Physical) model; and the AUTOS (Artifact, User, Task, Organization and Situation) pyramid. Concepts developed in this article are based on the rationalization of a long experience in the aerospace domain.

If a solvable problem is currently unsolved, then something important to a solution is most likely being overlooked. From this simple observation we derive the obscure features hypothesis: every innovative solution is built upon at least one commonly overlooked or new (i.e., obscure) feature of the problem. By using a new definition of a feature as an effect of an interaction, we are able to accomplish five things. First, we are able to determine where features come from and how to search for new ones. Second, we are able to construct mathematical arguments that the set of features of an object is not computably enumerable. Third, we are able to characterize innovative problem solving as looking for a series of interactions that produce the desired effects (i.e., the goal). Fourth, we are able to construct a precise problem-solving grammar that is both human and machine friendly. Fifth, we are able to devise a visual and verbal problem-solving representation that both humans and computers can contribute to as they help counteract each other's problem-solving weaknesses. We show how computers can counter some of the known cognitive obstacles to innovation that humans have. We also briefly discuss ways in which humans can return the favor. We conclude that a promising process for innovative problem solving is a human–computer collaboration in which each partner assists the other in unearthing the obscure features of a problem.

Tangible interaction is an emerging field of human–computer interaction that links the digital and the physical worlds by embedding computation in physical artifacts and environments. This paper shares our experience teaching tangible interaction over the past 4 years in an interdisciplinary, project-based laboratory course at Tufts University. Although the course is offered through the Computer Science Department, it reflects the multidisciplinary nature of the field, merging product engineering practices with a design studio approach. With a diverse mix of students, this approach has fostered creativity and hands-on learning. Throughout the course students have created innovative interfaces that not only capture fundamental concepts of tangible interaction but also contribute novel techniques for supporting collaborative design. We discuss examples of student-created interfaces and illustrate the relationship between the methods employed in the course and the artifacts created. We also share our recommendations for implementing such a course in institutions with constraints similar to ours including a limited budget and minimal laboratory space.

Background: A dietary assessment website for use in the primary health care setting has been developed. The website allows patients, referred from their general practitioners (GP), to self-report their dietary intake. Data from the website feeds to a dietitian who develops individualised dietary advice for the patient. Aim: The aim of this article is to describe the usability testing of the dietary assessment website with its potential users. Methods: Testing was broken into two phases. Forty-two free-living adults with metabolic syndrome volunteered, 17 completed phase 1 and 10 completed phase 2, with a 64% rate of completion. Phase 1 participants spoke aloud as they progressed through the self-administered dietary assessment website under researcher observation. Observed difficulties in website use and need for assistance was recorded and the website underwent modifications between phases. Only four participants in phase 1 required large amounts of assistance. Phase 2 participants progressed through the website without observation or using the think-aloud protocol. This simulated the environment in the GP practice within which the website was to be implemented. All participants completed pre- and post-use questionnaires assessing feelings toward use, computer experience and problems encountered. Findings: Questionnaires were thematically analysed for relationships between website use and participant feelings. Time taken to use the website was recorded automatically. Website features were grouped into ‘action classes’, for example selecting food items, and times taken were calculated for each class. Comparisons (t-tests) were made between the action classes for the two phases. Average time taken to select the food items was 31 min and 24 min for phases 1 and 2, respectively. Total time taken was approximately 1 h and varied by 4 min between phases. Time taken to complete the dietary assessment was comparable to a face-to-face diet history with a dietitian. The website was found to be highly user friendly with little assistance being required for most levels of computer experience. Dietary management may be overlooked by GPs, yet by offering different methods of accessing dietitians, management may improve.