There is Always a Way: Organizing VR User Tests with Remote and Hybrid Setups during a Pandemic—Learnings from Five Case Studies

(1) COVID-19 pandemic restrictions caused a dramatic shift in research activities, forcing the adoption of remote practices and methods. Despite the known benefits of remote testing, there is limited knowledge on how to prepare and conduct such studies in the industrial context where the target users are experts and company employees. (2) In this article, we detail how we organized VR user tests in five industrial cases during the pandemic, focusing on practicalities and procedures. We cover both on-site testing, including disinfecting and other safety protocols, as well as remote and hybrid setups where both remote and on-site participants were involved. Subject matter experts from eight countries were involved in a total of 22 tests. (3) We share insights for VR user test arrangements relevant to the pandemic, remote and hybrid setups, and an industrial context, among others. (4) Our work confirms that with careful planning it is possible to organize user tests remotely. There are also some limitations in remote user testing, such as reduced visibility and interaction with participants. Most importantly, we list practical recommendations for organizing hybrid user tests with safety and disinfecting procedures for on-site VR use.

Download Full-text

Surviving the International Usability Test: Tools and Strategies for a Successful Outcome

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120504902403 ◽

2005 ◽

Vol 49 (24) ◽

pp. 2080-2084

Author(s):

M. Kathryn Peterson ◽

Leigh Lammert Parker

Keyword(s):

International Study ◽

Usability Testing ◽

Successful Outcome ◽

Test Plan ◽

User Testing ◽

Barriers To Success ◽

Preparation Time ◽

Testing Tools ◽

Local Resources ◽

Remote User

International usability testing presents unique challenges for planning and conducting labs. Many factors that affect the design and execution of an international study — factors such as travel requirements, participant recruiting, test plan and interface localization, translation, and legal agreements — make the challenges seem insurmountable. However, increasing preparation time, using local resources, and utilizing remote user testing tools will significantly reduce costs and barriers to success.

Download Full-text

On the lack of research competencies among teachers of secondary vocational education: the results of the study

Vocational education and labour market ◽

10.52944/port.2021.45.2.009 ◽

2021 ◽

pp. 112-125

Author(s):

А.А. Коновалов ◽

Д.Е. Щипанова ◽

А.И. Лыжин ◽

Б.А. Чернышов

Keyword(s):

Vocational Education ◽

Vocational Training ◽

Online Survey ◽

Statistical Processing ◽

Research Data ◽

Professional Activity ◽

Secondary Vocational Education ◽

Research Activities ◽

Research Competencies ◽

Practical Recommendations

Статья посвящена проблеме формирования и развития исследовательских компетенций, которые, по мнению авторов, являются необходимым условием успешной профессиональной деятельности педагога СПО. Цель статьи — выявление дефицита исследовательских компетенций у педагогов профессионального обучения, а также определение направления развития научно-исследовательской деятельности (НИД) в сфере СПО. Для достижения поставленной цели было проведено анкетирование с помощью онлайн-опроса, разработанного на базе инструментов GoogleForms, и применены методы статистической обработки данных исследования. В статье представлены структура и виды научно-исследовательской деятельности педагога СПО, приведены результаты эмпирического исследования, позволившие оценить степень сформированности профессиональных компетенций педагогических работников и их готовность к осуществлению НИД. Авторы предлагают практические рекомендации по восполнению дефицита исследовательских компетенций у педагогов профессионального обучения. The article is devoted to the problem of formation and development of research competencies, which, according to the authors, are necessary for the successful professional activity of a teacher of secondary vocational education. The purpose of the article is to identify the lack of research competencies among teachers of vocational training and determine the direction of development of research activities (RA) in the field of secondary vocational education. In order to achieve this goal, a survey was conducted using an online survey developed based on GoogleForms tools, and methods of statistical processing of research data were applied. The article presents the structure and types of research activities of a teacher of secondary vocational education, the results of an empirical study that allowed us to assess the degree of formation of professional competencies of teachers and their readiness to implement the RA. The authors offer practical recommendations for filling the deficit of research competencies in teachers of vocational training.

Download Full-text

Reducing Sample Sizes When User Testing with People Who Have, and Who are Simulating Disabilities - Experiences with Blindness and Public Information Kiosks

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120004402607 ◽

2000 ◽

Vol 44 (26) ◽

pp. 157-160 ◽

Cited By ~ 4

Author(s):

Chris M. Law ◽

Gregg C. Vanderheiden

Keyword(s):

Return On Investment ◽

Public Information ◽

Low Frequency ◽

People With Disabilities ◽

The Other ◽

Objective Measures ◽

User Testing ◽

User Test ◽

Average Probability ◽

Reducing Costs

Researchers have suggested running fewer subjects to reduce costs of usability testing of mainstream products (Virzi 1990, 1992, Nielsen and Landauer, 1993, Lewis, 1994). It has been demonstrated that, depending on the average probability of subjects revealing problems ( p), most of the problems inherent in an interface will be found in the first few subjects, and adding more subjects gives little return on investment. As part of an investigation aimed at reducing costs in user testing of people with disabilities, a user test was conducted to compare the differences between a group of 15 blind, and 15 blindfolded (sighted) subjects using a touchscreen public information kiosk that was intended for use by people who cannot see. The number and type of problems found by each group were compared, and it was found that the results between each group were mostly similar: the value of p was within 3% (blind p=0.31; blindfolded p=0.34); each group found 46 of a total 53 problems (and therefore did not find 7 problems that the other group found, 6 of which were low frequency problems); 80% of the problems were found by the first 6, and the first 5 subjects of the blind and blindfolded groups respectively; the number of problems found in four evaluation categories were also similar. The need for further study in this area, in terms of tests using different disability types and other types of subjective and objective measures, and possibilities for using mixed subject pools of people who have and people who are simulating disabilities, are discussed.

Download Full-text

Remote Interviews and Visual Timelines with Patients: Lessons Learned

Studies in Health Technology and Informatics - Public Health and Informatics ◽

10.3233/shti210298 ◽

2021 ◽

Author(s):

Paula Valkonen ◽

Nina Karisalmi ◽

Johanna Kaipio ◽

Sari Kujala

Keyword(s):

Well Being ◽

Lessons Learned ◽

User Studies ◽

Careful Planning ◽

Extra Effort ◽

Sensitive Topics ◽

Health Related ◽

Rich Data ◽

Confidentiality And Privacy ◽

Remote User

This article aims to support the design of remote user studies in the healthcare and well-being field. We introduce lessons learned from conducting remote interviews and using visual timelines as pretasks involving patients from two eHealth projects. Based on our experience, we conclude that remote interviews and visual timelines can provide rich data about user needs. However, careful planning is required. Building trust, rapport, confidentiality, and privacy requires extra effort from the researcher in studies involving sensitive topics. In this paper, we present a list of practical tips for planning qualitative health-related user studies.

Download Full-text

APLIKASI SIMULASI MEMBUAT SIM C BERBASIS ANDROID

Jurnal Teknika ◽

10.30736/teknika.v9i2.60 ◽

2017 ◽

Vol 9 (2) ◽

pp. 8

Author(s):

Achmad Syaiful Anam ◽

Retno Wardhani ◽

Masruroh Masruroh

Keyword(s):

Black Box ◽

User Testing ◽

Traffic Sign ◽

Blind Test ◽

Driving License ◽

Traffic Regulation ◽

User Test ◽

Black Box Testing ◽

Box Method ◽

Theory Test

Driving license is a registration proof and identification that is given by Indonesian Nation Police to someone who is fulfilled the administrative requirement, physically and mentally healthy, understand the traffic regulation, and skilled motorcycle driving. The survey result shows that not all people who have motorcycle have C driving license, eight of ten people say that they are afraid and have not understood the procedure of making C driving license yet. The motorcycle driver ha ve not passed the C driving license test frequently because they have not understood the theory of traffic sign and road marking, and driving the motorcycle yet. Based on that problem C Driving license Simulation Application Android Based is made as the research tittle. This application is developed based on Construct 2, the stages of developing Application is started from collecting the data (color-blind test, theory test, practice test’s information, and driving license information), then designing the pr ogram’s interface and program system’s groove, and the last one is black box testing and user testing. The implementation result of internal test (developing) Application test is based on Black Box method. Implementation result of user test based on the qu estionnaire from 50 respondents used likert scale was gotten 89%. So, it can be concluded that C Driving license Simulation Application is the good one

Download Full-text

Matching Co-innovation Project Types to Diverse Customer Relationships: Perspective of an Industrial Technology Supplier

International Journal of Innovation and Technology Management ◽

10.1142/s0219877020500480 ◽

2020 ◽

pp. 2050048

Author(s):

Tuula Lehtimäki ◽

Hanna Komulainen

Keyword(s):

Qualitative Study ◽

Customer Relationships ◽

Customer Relationship ◽

Industrial Technology ◽

Careful Planning ◽

Innovation Research ◽

Relationship Types ◽

Innovation Projects ◽

Innovation Project ◽

Industrial Context

Co-innovation between suppliers and their customers provides important benefits but is not without challenges. Especially in technologically complex industrial context co-innovation projects need careful planning and preparing. Through eight cases, this qualitative study takes the perspective of the supplier and empirically identifies three types of supplier-customer co-innovation projects and for each project type, the supplier’s co-innovation goal, potential matching customer relationships, and related managerial benefits and challenges are described. The results contribute to the co-innovation research by presenting a framework for matching supplier’s co-innovation goals to customer relationship types, which brings out the variety of co-innovation projects that even a single supplier can face and must manage.

Download Full-text

ON THE QUESTION OF WRITING AND PRESENTING EDUCATIONAL AND RESEARCH WORKS OF SCHOOLCHILDREN

Bulletin of the Chuvash State Pedagogical University named after I Y Yakovlev ◽

10.37972/chgpu.2021.111.2.022 ◽

2021 ◽

pp. 180-188

Author(s):

Елена Витальевна Король ◽

Татьяна Сергеевна Царская

Keyword(s):

Secondary Education ◽

Research Work ◽

Cognitive Activity ◽

Educational Institutions ◽

Educational Standard ◽

Research Activities ◽

Scientific Practical ◽

State Educational ◽

Pedagogical Literature ◽

Practical Recommendations

Современные методы и подходы в системе среднего образования позволяют заниматься исследовательской деятельностью школьникам разных возрастных категорий с учетом их индивидуальных интеллектуальных потребностей и возможностей. Ощущение удовлетворения учащихся от успешного выполнения учебно-исследовательской работы повышает у них познавательную активность и интерес как к самому процессу обучения, так и к дальнейшей исследовательской деятельности в будущем. В данной статье актуализируется проблема написания учебно-исследовательских работ учащихся среднеобразовательных учреждений в соответствии с требованиями Государственного образовательного стандарта среднего образования. На основе теоретического анализа психолого-педагогической литературы и практического многолетнего опыта работы в качестве члена жюри в секции «Иностранные языки» на различных этапах научно -практической конференции учащихся «Шаг в будущее» авторы предлагают практические рекомендации по подготовке к написанию и представлению учебно-исследовательских работ в аспекте изучения иностранного языка. Modern methods and approaches in the secondary education system allow pupils of different age categories to engage in research activities, taking into account their individual intellectual needs and capabilities. The feeling of satisfaction of pupils from the successful completion of educational research work increases their cognitive activity and interest both in the learning process itself and in further research activities in the future.This article actualizes the problem of writing educational and research papers by students of secondary educational institutions in accordance with the requirements of the State Educational Standard of Secondary Education. Based on the theoretical analysis of psychological and pedagogical literature and practical longterm experience as a member of the jury in the “Foreign Languages” section at various stages of the scientific-practical conference of schoolchildren “Step into the Future”, the authors offer practical recommendations for writing and presenting educational and research work in the aspect of learning a foreign language.

Download Full-text

Identification and Control of Potential Variables in User Testing of PPE for Industrial Operations

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120204602409 ◽

2002 ◽

Vol 46 (24) ◽

pp. 1978-1981

Author(s):

Cindy R. Ching ◽

Robert P. Reisdorf ◽

D. Susan McGlothlin

Keyword(s):

Data Collection ◽

Test Validity ◽

Performance Criteria ◽

Control Potential ◽

User Testing ◽

User Test ◽

Industrial Operations ◽

Successful Design ◽

Design Bias ◽

And Control

The user test was designed to control variables in the design, bias by the data collectors and test participants, and inconsistency in data collection. Test validity was also a concern. The purpose of this presentation is to describe the design of user testing to identify and control potential variables to minimize bias in testing and selection. The goal of the user testing was to determine which aprons would meet selected performance criteria and also be readily accepted by workers. The successful design of this apron study will be applied to the design of studies to select other PPE such as coveralls and hoods.

Download Full-text