Metrics in Human Robot Interaction for new users

This project aims to create a repository of Human-Robot Interaction (HRI) with the collective contribution of the HRI research community.

It will offer easy access to standard metrics used in HRI for students, new researchers, and the general public interested in HRI.

Curating many metrics relies on a collective effort from the HRI community. Please help and support new HRI students, early career researchers, and the public by sharing your knowledge in HRI and making available these metrics to them. We encourage all the HRI researchers around the world to send us the metrics that you have used in doing HRI research. Your effort will help build a stronger HRI community and generate more agile HRI research developed by the new generation of HRI researchers.

Please use the link in Qualtrics here to submit your contribution.

Please see the metrics that we already collected for new researchers below. Hansul and Eduardo have been reviewing HRI a significant number of papers from journals and relevant conferences and asking around to other researchers. Now, we have 28 metrics in a simple format. We provide the original source of each metric and pertinent data in a simple table. Please check them below.

We start small, and your contribution will be built up as a useful reference point for Human Robot Interaction studies amongst all kinds of users! 😃🤖 🫱🏻‍🫲🏽

Again, to submit your proposal to the metrics repository, please click this link below (https://unsw.au1.qualtrics.com/jfe/form/SV_2c9Hcc8nOX3CBWm)

A few minutes of your time will be a massive benefit to the HRI community. We will keep you posted on the progress of this collection on this website and keep working on this continuously 🤓

Kind Regards, 

Eduardo and Hansul

Metrics used in HRI research

Here, you can check some metrics used in HRI research collected by Hansul and Eduardo in a simple format. Links will lead you to the original sources and are independent of us. We are adding the scales as soon as we receive them. You can copy and paste the table and create your own dynamic table.

ScaleReferenceURL
NARS (Negative Attitude Towards Robots Scale)Measurement of Negative Attitudes Towards Robots. https://site.unibo.it/hfrs/en/questionnaire-and-scales-2/nars
TIPI Test (Ten Item Personality Measure of the Big Five)A Very Brief Measure of the Big-Five Personality Domains.https://doi.org/10.1016/S0092-6566(03)00046-1
Godspeed QuestionnaireMeasurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robotshttps://link.springer.com/article/10.1007/s12369-008-0001-3
NASA TLX (NASA Task Load Index)Mental Workload assessment method. Human factors methods: a practical guide for engineering and design.http://humansystems.arc.nasa.gov/groups/TLX/
Meausrement Scales for Perceived Usefulness and Perceived Easy of Use (TAM)Perceived Usefulness, Perceived Easy of Use, and User Acceptance of Information Technologyhttps://doi.org/10.2307/249008
Unified Theory of Acceptance and Use of Technology (UTAUT)User Acceptance of Information Technology: Toward a Unified Viewhttps://www.jstor.org/stable/30036540
Senior Technology Acceptance Model (STAM)Gerontechnology acceptance by elderly Hong Kong Chinese: a senior technology acceptance model (STAM)https://doi.org/10.1080/00140139.2014.895855
Implicit Association TEST (IAT)Measuring Individual Differences in Implicit Cognition: The Implicit Association Testhttps://doi.org/10.1037//0022-3514.74.6.1464
Interpersonal Reactivity Index (IRI)A Multidimensinoal Approach to Individual Differences in Empathyhttps://doi.org/10.1037/0022-3514.44.1.113
The Checklist for TrustFoundations for an Empirically Determined Scale of Trust in Automated Systemshttps://doi.org/10.1207/S15327566IJCE0401_04
Questions Regarding Acceptance, Empathy, Trust and HealthChidlren’s responses and opinion on three bots that motivate, educate and playhttps://doi.org/10.14198/JoPha.2008.2.2.03
Trust Perception Scale-HRIMeasuring Trust in Human Robot Interactions: Development of the “Trust Perception Scale-HRI”https://doi.org/10.1007/978-1-4899-7668-0_10
Berkeley Expressivity QuestionnaireBerkeley Expressivity Questionnairehttps://doi.org/10.1037/t00749-000
Individual Differences Anthromopomorphism QuestionnaireWho Sees Human? The Stability and Importance of Individual Differences in Anthromorphismhttps://doi.org/10.1177/1745691610369336
International Personality Item Pool – Five-Factor Model Measure (IPIP-Big5)A Broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several Five-Factor modelshttps://ipip.ori.org/A%20broad-bandwidth%20inventory.pdf
Mini International Personality Item Pool – Five-Factor Model Measure (Mini-IPIP)The Mini-IPIP Scales: Tiny-Yet-Effective Measures of the Big Five Factors of Personalityhttps://doi.org/10.1037/1040-3590.18.2.192
General Attitudes Towards Robots Scale (GAToRS)General Attitudes Towards Robots Scale (GAToRS): A New Instrument for Social Surveyshttps://doi.org/10.1007/s12369-022-00880-3
Almere Model of Robot AcceptanceAssessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Modelhttps://doi.org/10.1007/s12369-010-0068-5
Robot Anxiety Scale (RAS)Measuring of Anxiety toward Robotshttps://doi.org/10.1109/ROMAN.2006.314462
Usability Testing Scale (SUS)SUS – A Quick and Dirty Usability Scalehttps://www.semanticscholar.org/paper/SUS%3A-A-‘Quick-and-Dirty’-Usability-Scale-Brooke/79596de8da82cbb219e88b45c808b052606f765d
Human-Robot Interaction Trust ScaleYou Want Me to Trust a ROBOT? The Development of a Human-Robot Interaction Trust Scalehttps://doi.org/10.1007/s12369-012-0144-0
Interpersonal Trust Scale (ITS)A New Scale for the Measurement of Interpersonal Trusthttps://doi.org/10.1111/j.1467-6494.1967.tb01454.x
Anthropomorphic Tendencies Scale (ATS)Developing and Anthropomorphic Tendencies Scalehttps://doi.org/10.1177/154193120504901311
User Engagement Scale (UES)A Practical Approach to Measuring User Engagement with the Refined User Engagement Scale (UES) and New UES Short Formhttps://doi.org/10.1016/j.ijhcs.2018.01.004
The Robotic Social Attributes Scale (RoSAS)The Robotic Social Attributes Scale (RoSAS): Development and Validationhttp://dx.doi.org/10.1145/2909824.3020208
Conversation with the RobotFace-to-Face with a Robot: What Do We Actually Talk About?https://doi.org/10.1142/S0219843613500114
Table 1. The spreadsheet in a simple format for common and popular metrics used in HRI. We will update the table once we receive submissions and inform the users.

Leave a Comment