Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding

Hope Diamantopoulos; Weitian Wang

doi:10.1109/ICMAE52228.2021.9522451

Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding

Hope Diamantopoulos, Weitian Wang

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Scopus citations

Abstract

Human-robot collaboration is inevitable in future smart manufacturing. In order to ensure safe human-robot collaboration, we develop a transfer learning-based approach to teach the robot to understand human emotions in smart manufacturing contexts. Our approach enables the robot to accurately understand human emotions and accommodate its human partner with corresponding assisting actions in collaborative tasks. This allows for improved collaboration-safety and enhanced ergonomics in human-robot partnerships. Experimental results and evaluations demonstrate that the robot can precisely understand human emotions in real time and effectively assist its human partner in real-world co-assembly tasks. Future work for this study is also discussed.

Original language	English
Title of host publication	2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	523-528
Number of pages	6
ISBN (Electronic)	9781665433211
DOIs	https://doi.org/10.1109/ICMAE52228.2021.9522451
State	Published - 16 Jul 2021
Event	12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021 - Virtual, Athens, Greece Duration: 16 Jul 2021 → 19 Jul 2021

Publication series

Name	2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021

Conference

Conference	12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021
Country/Territory	Greece
City	Virtual, Athens
Period	16/07/21 → 19/07/21

Keywords

Human-robot interaction
Intelligent control
Machine learning
Robotics
Vision system

Access to Document

10.1109/ICMAE52228.2021.9522451

Cite this

Diamantopoulos, H., & Wang, W. (2021). Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding. In 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021 (pp. 523-528). (2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMAE52228.2021.9522451

Diamantopoulos, Hope ; Wang, Weitian. / Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding. 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 523-528 (2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021).

@inproceedings{0f6ef3a389134fb6b56b2cd1cf382358,

title = "Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding",

abstract = "Human-robot collaboration is inevitable in future smart manufacturing. In order to ensure safe human-robot collaboration, we develop a transfer learning-based approach to teach the robot to understand human emotions in smart manufacturing contexts. Our approach enables the robot to accurately understand human emotions and accommodate its human partner with corresponding assisting actions in collaborative tasks. This allows for improved collaboration-safety and enhanced ergonomics in human-robot partnerships. Experimental results and evaluations demonstrate that the robot can precisely understand human emotions in real time and effectively assist its human partner in real-world co-assembly tasks. Future work for this study is also discussed. ",

keywords = "Human-robot interaction, Intelligent control, Machine learning, Robotics, Vision system",

author = "Hope Diamantopoulos and Weitian Wang",

note = "Funding Information: The authors would thank the great support provided in conducting this research from the Department of Computer Science and the Dean s Office of the College of Science and Mathematics at Montclair State University. Funding Information: ACKNOWLEDGMENT The authors would thank the great support provided in conducting this research from the Department of Computer Science and the Dean{\textquoteright}s Office of the College of Science and Mathematics at Montclair State University. Publisher Copyright: {\textcopyright} 2021 IEEE.; null ; Conference date: 16-07-2021 Through 19-07-2021",

year = "2021",

month = jul,

day = "16",

doi = "10.1109/ICMAE52228.2021.9522451",

language = "English",

series = "2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "523--528",

booktitle = "2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021",

}

Diamantopoulos, H & Wang, W 2021, Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding. in 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021. 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021, Institute of Electrical and Electronics Engineers Inc., pp. 523-528, 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021, Virtual, Athens, Greece, 16/07/21. https://doi.org/10.1109/ICMAE52228.2021.9522451

Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding. / Diamantopoulos, Hope; Wang, Weitian.

2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021. Institute of Electrical and Electronics Engineers Inc., 2021. p. 523-528 (2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding

AU - Diamantopoulos, Hope

AU - Wang, Weitian

N1 - Funding Information: The authors would thank the great support provided in conducting this research from the Department of Computer Science and the Dean s Office of the College of Science and Mathematics at Montclair State University. Funding Information: ACKNOWLEDGMENT The authors would thank the great support provided in conducting this research from the Department of Computer Science and the Dean’s Office of the College of Science and Mathematics at Montclair State University. Publisher Copyright: © 2021 IEEE.

PY - 2021/7/16

Y1 - 2021/7/16

N2 - Human-robot collaboration is inevitable in future smart manufacturing. In order to ensure safe human-robot collaboration, we develop a transfer learning-based approach to teach the robot to understand human emotions in smart manufacturing contexts. Our approach enables the robot to accurately understand human emotions and accommodate its human partner with corresponding assisting actions in collaborative tasks. This allows for improved collaboration-safety and enhanced ergonomics in human-robot partnerships. Experimental results and evaluations demonstrate that the robot can precisely understand human emotions in real time and effectively assist its human partner in real-world co-assembly tasks. Future work for this study is also discussed.

AB - Human-robot collaboration is inevitable in future smart manufacturing. In order to ensure safe human-robot collaboration, we develop a transfer learning-based approach to teach the robot to understand human emotions in smart manufacturing contexts. Our approach enables the robot to accurately understand human emotions and accommodate its human partner with corresponding assisting actions in collaborative tasks. This allows for improved collaboration-safety and enhanced ergonomics in human-robot partnerships. Experimental results and evaluations demonstrate that the robot can precisely understand human emotions in real time and effectively assist its human partner in real-world co-assembly tasks. Future work for this study is also discussed.

KW - Human-robot interaction

KW - Intelligent control

KW - Machine learning

KW - Robotics

KW - Vision system

UR - http://www.scopus.com/inward/record.url?scp=85115432417&partnerID=8YFLogxK

U2 - 10.1109/ICMAE52228.2021.9522451

DO - 10.1109/ICMAE52228.2021.9522451

M3 - Conference contribution

AN - SCOPUS:85115432417

T3 - 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021

SP - 523

EP - 528

BT - 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 16 July 2021 through 19 July 2021

ER -

Diamantopoulos H, Wang W. Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding. In 2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021. Institute of Electrical and Electronics Engineers Inc. 2021. p. 523-528. (2021 12th International Conference on Mechanical and Aerospace Engineering, ICMAE 2021). doi: 10.1109/ICMAE52228.2021.9522451

Accommodating and assisting human partners in human-robot collaborative tasks through emotion understanding

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this