[en] When flying robots are used in close-range interaction with humans, the noise they generate, also called consequential sound, is a critical parameter for user acceptance. We conjecture that there is a benefit in adding natural sounds to noisy domestic drones. To test our hypothesis experimentally, we carried out a mixed-methods research study (N=56) on reported user perception of a sonified domestic flying robot with three sound conditions at three distances. The natural sounds studied were respectively added to the robot’s inherent noises during flying; namely a birdsong and a rain sound, plus a control condition of no added sound. The distances studied were set according to proxemics; namely near, middle, and far. Our results show that adding birdsong or rain sound affects the participants’ perceptions, and the proxemic distances play a nonnegligible role. For instance, we found that participants liked the bird condition the most when the drone was at far, while they disliked the same sound the most when at near. We also found that participants’ perceptions strongly depended on their associations and interpretations deriving from previous experience. We derived six concrete design recommendations.
Disciplines :
Engineering, computing & technology: Multidisciplinary, general & others Social & behavioral sciences, psychology: Multidisciplinary, general & others
Author, co-author :
WANG, Ziming ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS) > Institute of Cognitive Science and Assessment (COSA) ; Chalmers University of Technology, Sweden > Department of Computer Science and Engineering (CSE)
Hu, Ziyi; Chalmers University of Technology, Sweden
ROHLES, Björn ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)
Ljungblad, Sara; Univerity of Gothenburg, Sweden ; Chalmers University of Technology, Sweden
KOENIG, Vincent ; University of Luxembourg > Faculty of Humanities, Education and Social Sciences (FHSE) > Department of Behavioural and Cognitive Sciences (DBCS)
Fjeld, Morten; Chalmers University of Technology, Sweden ; University of Bergen, Norway
External co-authors :
yes
Language :
English
Title :
The Effects of Natural Sounds and Proxemic Distances on the Perception of a Noisy Domestic Flying Robot
Publication date :
10 January 2023
Journal title :
ACM Transactions on Human - Robot Interaction
eISSN :
2573-9522
Publisher :
Association for Computing Machinery (ACM), New York, United States
Parastoo Abtahi, David Y. Zhao, Jane L. E., and James A. Landay. 2017. Drone near me: Exploring touch-based human-drone interaction. Proc. ACM Interact. Mob. Wear. Ubiq. Technol. 1, 3 (Sep. 2017). DOI: https://doi.org/10.1145/3130899
Östen Axelsson, Mats E. Nilsson, Björn Hellström, and Peter Lundén. 2014. A field experiment on the impact of sounds from a jet-and-basin fountain on soundscape quality in an urban park. Landsc. Urb. Plan. 123 (2014), 49-60.
Christopher C. Berger and H. Henrik Ehrsson. 2013. Mental imagery changes multisensory perception. Curr. Biol. 23, 14 (2013), 1367-1372.
Cindy L. Bethel and Robin R. Murphy. 2006. Auditory and other non-verbal expressions of affect for robots. In AAAI Fall Symposium: Aurally Informed Performance . 1-5.
BetterUp. 2022. You have more than 5 Human Senses. How Are You Using Yours?. Retrieved from https://www. betterup.com/blog/human-senses
Jens Blauert and Ute Jekosch. 1997. Sound-quality evaluation-A multi-layered problem. Acta Acust. United Acust. 83, 5 (Sept./Oct. 1997), 747-753(7). Retrieved from https://www.ingentaconnect.com/content/dav/aaua/1997/00000083/00000005/art00005?utm-source=TrendMD&utm-medium=cpc&utm-campaign=Acta-Acustica-united-with-Acus tica-TrendMD-0
Gregory N. Bratman, Hector A. Olvera-Alvarez, and James J. Gross. 2021. The affective benefits of nature exposure. Social and Personality Psychology Compass 15, 8 (2021), e12630. https://doi.org/10.1111/spc3.12630
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitat. Res. Psychol. 3, 2 (2006), 77-101.
Rachel T. Buxton, Amber L. Pearson, Claudia Allou, Kurt Fristrup, and George Wittemyer. 2021. A synthesis of health benefits of natural sounds and their distribution in national parks. Proc. Nat. Acad. Sci. 118, 14 (2021), e2013097118. DOI: https://doi.org/10.1073/pnas.2013097118
Jessica R. Cauchard, Jane L. E., Kevin Y. Zhai, and James A. Landay. 2015. Drone & me: An exploration into natu-ral human-drone interaction. In ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubi-Comp'15) . Association for Computing Machinery, New York, NY, 361-365. DOI: https://doi.org/10.1145/2750858. 2805823
Victoria Chang, Pramod Chundury, and Marshini Chetty. 2017. Spiders in the sky: User perceptions of drones, pri-vacy, and security. In CHI Conference on Human Factors in Computing Systems (CHI'17) . Association for Computing Machinery, New York, NY, 6765-6776. DOI: https://doi.org/10.1145/3025453.3025632
Bert De Coensel, Sofie Vanwetswinkel, and Dick Botteldooren. 2011. Effects of natural sounds on the perception of road traffic noise. J. Acoust. Societ. Amer. 129, 4 (2011), EL148-EL153.
Ashley Colley, Lasse Virtanen, Pascal Knierim, and Jonna Häkkilä. 2017. Investigating drone motion as pedestrian guidance. In 16th International Conference on Mobile and Ubiquitous Multimedia (MUM'17) . Association for Computing Machinery, New York, NY, 143-150. DOI: https://doi.org/10.1145/3152832.3152837
Crazyflie. 2022. Bitcraze. Retrieved from https://www.bitcraze.io/about/bitcraze
Customer reviews. 2022. DJI Mavic Pro Platinum 8331 Low-Noise Quick-Release Propellers-Gold Tips-2 Pairs. Retrieved from https://www.amazon.com/-/zh/product-reviews/B076K8CBH9/ref=cm-cr-dp-d-show-all-btm?ie=UTF8&reviewerType=all-reviews&language=en-US¤cy=USD
Saraswati Dawadi, Sagun Shrestha, and Ram A. Giri. 2021. Mixed-methods research: A discussion on its types, chal-lenges, and criticisms. Journal of Practical Studies in Education 2, 2 (2021), 25-36. https://doi.org/10.46809/jpse.v2i2.20
Rob Diaz-Marino and Miaosen Wang. 2011. Proxemic interactions: The new Ubicomp? Interactions XVIII.1, 4 (2011), 42-50. DOI: https://doi.org/10.1145/1897239.1897250
Brittany A. Duncan and Robin R. Murphy. 2013. Comfortable approach distance with small unmanned aerial vehicles. In IEEE International Symposium on Robot and Human Interactive Communication . 786-792. DOI: https://doi.org/10.1109/ROMAN.2013.6628409
Marcel Eens, Rianne Pinxten, Rudolf F. Verheyen, Ronny Blust, and Lieven Bervoets. 1999. Great and blue tits as indicators of heavy metal contamination in terrestrial ecosystems. Ecotoxic. Environ. Safet. 44, 1 (1999), 81-85.
Etikprovnings myndigheten (Ethics Review Authority). 2022. Vanliga Fragor (Common Questions about Ethical Re-view). (2022). Retrieved from https://etikprovningsmyndigheten.se/vanliga-fragor/
Hugo Fastl and Eberhard Zwicker. 2007. Psychoacoustics: Facts and Models (3rd. ed.). Springer Berlin. DOI: https://doi.org/10.1007/978-3-540-68888-4
Emma Frid, Roberto Bresin, and Simon Alexanderson. 2018. Perception of mechanical sounds inherent to expressive gestures of a NAO robot-implications for movement sonification of humanoids. In Proceedings of the Sound and Music Computing Conference (SMC) , 53-59. https://doi.org/10.5281/zenodo.1422499
Laurent Galbrun and Tahrir T. Ali. 2013. Acoustical and perceptual assessment of water sounds and their use over road traffic noise. J. Acoust. Societ. Amer. 133, 1 (2013), 227-237.
Wouter Halfwerk and Hans Slabbekoorn. 2009. A behavioural mechanism explaining noise-dependent frequency use in urban birdsong. Anim. Behav. 78, 6 (2009), 1301-1307.
Edward T. Hall. 1966. The Hidden Dimension . Doubleday, Garden City, NJ
Yiying Hao, Jian Kang, and Heinrich Wörtche. 2016. Assessment of the masking effects of birdsong on the road traffic noise environment. J. Acoust. Societ. Amer. 140, 2 (2016), 978-987.
Marc Hassenzahl. 2003. The thing and I: Understanding the relationship between user and product. In Funology . Springer, 31-42.
IBM. 2022. IBM SPSS Statistics. Retrieved from https://www.ibm.com/products/spss-statistics
Kaoru Inoue, Kazuyoshi Wada, and Yuko Ito. 2008. Effective application of Paro: Seal type robots for disabled people in according to ideas of occupational therapists. In International Conference on Computers for Handicapped Persons . Springer, 1321-1324.
Betina Ip and Holly Bridge. 2020. Learning to see in 3D with two eyes: The role of experience, plasticity and neuro-chemistry. Biochemist 42, 5 (09 2020), 12-17. DOI: https://doi.org/10.1042/BIO20200059
ISO 8373:2021(en). 2022. Robotics-Vocabulary. Retrieved from https://www.iso.org/obp/ui/#iso:std:iso:8373:ed-3:v1: en
Evangelos Karapanos. 2012. Modeling Users' Experiences with Interactive Systems . Vol. 436. Springer.
Joseph La Delfa, Mehmet Aydin Baytas, Rakesh Patibanda, Hazel Ngari, Rohit Ashok Khot, and Florian "Floyd" Mueller. 2020. Drone Chi: Somaesthetic Human-drone Interaction . Association for Computing Machinery, New York, NY, 1-13. DOI: https://doi.org/10.1145/3313831.3376786
Lau Langeveld, Renévan Egmond, Reinier Jansen, and Elif Özcan. 2013. Product sound design: Intentional and con-sequential sounds. In Advances in Industrial Design Engineering . IntechOpen. DOI: https://doi.org/10.5772/55274
Przemyslaw A. Lasota, Gregory F. Rossano, and Julie A. Shah. 2014. Toward safe close-proximity human-robot in-teraction with standard industrial robots. In IEEE International Conference on Automation Science and Engineering (CASE'14) . 339-344. DOI: https://doi.org/10.1109/CoASE.2014.6899348
Adrian Benigno Latupeirissa and Roberto Bresin. 2020. Understanding non-verbal sound of humanoid robots in films. In Workshop on Mental Models of Robots at HRI 2020 . Retrieved from http://kth.diva-portal.org/smash/record.jsf?pid=diva2%3A1454788&dswid=-8534
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience question-naire. In Symposium of the Austrian HCI and Usability Engineering Group . Springer, 63-76.
Timothy R. Levine and Craig R. Hullett. 2002. Eta squared, partial eta squared, and misreporting of effect size in communication research. Hum. Commun. Res. 28, 4 (2002), 612-625. DOI: https://doi.org/10.1111/j.1468-2958.2002. tb00828.x
Barry B. Ma, Jeffrey A. Nystuen, and Ren-Chieh Lien. 2005. Prediction of underwater sound levels from rain and wind. J. Acoust. Societ. Amer. 117, 6 (2005), 3555-3565.
Peggy Mason. 2017. Medical Neurobiology (2nd. ed.). Oxford University Press. DOI: https://doi.org/10.1093/med/9780190237493.001.0001
MAXQDA. 2022. Introducing MAXQDA 2022. Retrieved from https://www.maxqda.com/new-maxqda-2022
Dubravko Miljković. 2018. Methods for attenuation of unmanned aerial vehicle noise. In 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO'18) . 0914-0919. DOI: https://doi.org/10.23919/MIPRO.2018.8400169
Abdirahman Mohamud and Ashwin Ashok. 2018. Drone noise reduction through audio waveguiding. In4th ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications (DroNet'18). Association for Computing Machinery, New York, NY, 92-94. DOI: https://doi.org/10.1145/3213526.3213543
Dylan Moore, Tobias Dahl, Paula Varela, Wendy Ju, Tormod Naes, and Ingunn Berget. 2019. Unintended consonances: Methods to understand robot motor sound perception. In CHI Conference on Human Factors in Computing Systems (CHI'19) . Association for Computing Machinery, New York, NY, 1-12. DOI: https://doi.org/10.1145/3290605.3300730
Dylan Moore, Hamish Tennent, Nikolas Martelaro, and Wendy Ju. 2017. Making noise intentional: A study of servo sound perception. In ACM/IEEE International Conference on Human-Robot Interaction (HRI'17) . Association for Com-puting Machinery, New York, NY, 12-21. DOI: https://doi.org/10.1145/2909824.3020238
Michael Narine. 2020. Active Noise Cancellation of Drone Propeller Noise through Waveform Approximation and Pitch-shifting . Master's Thesis. Georgia State University, Atlanta, GA. Retrieved from https://scholarworks.gsu.edu/cs-theses/98
Eduardo Narváez, Ankit A. Ravankar, Abhijeet Ravankar, Takanori Emaru, and Yukinori Kobayashi. 2021. Au-tonomous VTOL-UAV docking system for heterogeneous multirobot team. IEEE Trans. Instrum. Measur. 70 (2021), 1-18. DOI: https://doi.org/10.1109/TIM.2020.3039649
Mohammad Obaid, Wafa Johal, and Omar Mubin. 2020. Domestic drones: Context of use in research literature. In 8th International Conference on Human-Agent Interaction (HAI'20) . Association for Computing Machinery, New York, NY, 196-203. DOI: https://doi.org/10.1145/3406499.3415076
Mohammad Obaid, Eduardo B. Sandoval, Jakub Złotowski, Elena Moltchanova, Christina A. Basedow, and Christoph Bartneck. 2016. Stop! That is close enough. How body postures influence human-robot proximity. In 25th IEEE Inter-national Symposium on Robot and Human Interactive Communication (RO-MAN'16) . 354-361. DOI: https://doi.org/10.1109/ROMAN.2016.7745155
Dinesh K. Pai. 2005. Multisensory interaction: Real and virtual. In 11th International Symposium on Robotics Research . Springer, 489-498.
Hannah Pelikan, Frederic Anthony Robinson, Leelo Keevallik, Mari Velonaki, Mathias Broth, and Oliver Bown. 2021. Sound in human-robot interaction. In ACM/IEEE International Conference on Human-Robot Interaction . 706-708.
RELAXOUND 2022. Treat Yourself with a Relaxing Bird Concert: with the Zwitscherbox. Retrieved from https://www.relaxound.com/en/zwitscherbox/
Anina N. Rich and Jason B. Mattingley. 2002. Anomalous perception in synaesthesia: A cognitive neuroscience per-spective. Nat. Rev. Neurosci. 3, 1 (2002), 43-52.
F. A. Robinson, O. Bown, and M. Velonaki. 2022. Designing sound for social robots: Candidate design principles. Int. J. Soc. Robot. 14 (2022), 1507-1525. DOI: https://doi.org/10.1007/s12369-022-00891-0
Frederic Anthony Robinson, Oliver Bown, and Mari Velonaki. 2020. Implicit communication through distributed sound design: Exploring a new modality in human-robot interaction. In ACM/IEEE International Conference on Human-Robot Interaction (HRI'20) . Association for Computing Machinery, New York, NY, 597-599. DOI: https://doi.org/10.1145/3371382.3377431
Frederic Anthony Robinson, Mari Velonaki, and Oliver Bown. 2021. Smooth operator: Tuning robot perception through artificial movement sound. In ACM/IEEE International Conference on Human-Robot Interaction (HRI'21) . As-sociation for Computing Machinery, New York, NY, 53-62. DOI: https://doi.org/10.1145/3434073.3444658
Vahid Saadatmand, Nahid Rejeh, Majideh Heravi-Karimooi, Sayed Davood Tadrisi, Farid Zayeri, Mojtaba Vaismoradi, and Melanie Jasper. 2013. Effect of nature-based sounds' intervention on agitation, anxiety, and stress in patients under mechanical ventilator support: A randomised controlled trial. Int. J. Nurs. Stud. 50, 7 (2013), 895-904.
Muzafer Sherif. 1935. A study of some social factors in perception. Archives of Psychology (Columbia University) . No. 187.
SVERIGES RIKSDAG (The Swedish Parliament). 2022. Lag (2003:460) om etikprövning av forskning som avser män-niskor (Law (2003: 460) on Ethical Review of Research Concerning People). Retrieved from https://www.riksdagen. se/sv/dokument-lagar/dokument/svensk-forfattningssamling/lag-2003460-om-etikprovning-av-forskning-som-sf s-2003-460
Daniel Szafir, Bilge Mutlu, and Terrence Fong. 2015. Communicating directionality in flying robots. In 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI'15) . 19-26.
Marta E. Szczygiel. 2016. From night soil to washlet: The material culture of Japanese toilets. Electron. J. Contemp. Japan. Stud. 16, 3 (2016), 12-2016.
Kazuki Takashima, Takafumi Oyama, Yusuke Asari, Ehud Sharlin, Saul Greenberg, and Yoshifumi Kitamura. 2016. Study and design of a shape-shifting wall display. In ACM Conference on Designing Interactive Systems . 796-806.
Hamish Tennent, Dylan Moore, Malte Jung, and Wendy Ju. 2017. Good vibrations: How consequential sounds affect perception of robotic arms. In 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN'17) . 928-935. DOI: https://doi.org/10.1109/ROMAN.2017.8172414
The DJI Store. 2022. Mavic 2 Low-Noise Propellers. Retrieved from https://m.dji.com/se/product/mavic-2-low-noise-propellers
Gabriele Trovato, Martin Do, Ömer Terlemez, Christian Mandery, Hiroyuki Ishii, Nadia Bianchi-Berthouze, Tamim Asfour, and Atsuo Takanishi. 2016. Is hugging a robot weird? Investigating the influence of robot appearance on users' perception of hugging. In 16th International Conference on Humanoid Robots (Humanoids'16) . IEEE, 318-323.
Gabriele Trovato, Renato Paredes, Javier Balvin, Francisco Cuellar, Nicolai Baek Thomsen, Soren Bech, and Zheng-Hua Tan. 2018. The sound or silence: Investigating the influence of robot noise on proxemics. In 27th IEEE Inter-national Symposium on Robot and Human Interactive Communication (RO-MAN'18) . 713-718. DOI: https://doi.org/10.1109/ROMAN.2018.8525795
Timothy Van Renterghem, Kris Vanhecke, Karlo Filipan, Kang Sun, Toon De Pessemier, Bert De Coensel, Wout Joseph, and Dick Botteldooren. 2020. Interactive soundscape augmentation by natural sounds in a noise polluted urban park. Landsc. Urb. Plan. 194 (2020), 103705.
Virtual Wall. 2022. How Do I Use Dual Mode Virtual Wall ®Barrier? Retrieved from https://homesupport.irobot.com/s/article/9053
Michael L. Walters, Mohammedreza A. Oskoei, Dag Sverre Syrdal, and Kerstin Dautenhahn. 2011. A long-term Human-Robot Proxemic study. In IEEE International Symposium on Robot and Human Interactive Communication . 137-142. DOI: https://doi.org/10.1109/ROMAN.2011.6005274
M. L. Walters, D. S. Syrdal, K. L. Koay, K. Dautenhahn, and R. te Boekhorst. 2008. Human approach distances to a mechanical-looking robot with different robot voice styles. In 17th IEEE International Symposium on Robot and Human Interactive Communication . 707-712. DOI: https://doi.org/10.1109/ROMAN.2008.4600750
Ziming Wang, Ziyi Hu, Yemao Man, and Morten Fjeld. 2022. A collaborative system of flying and ground robots with universal physical coupling interface (PCI), and the potential interactive applications. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI EA'22) . Association for Computing Machinery, New York, NY. DOI: https://doi.org/10.1145/3491101.3519766
Anna Wojciechowska, Jeremy Frey, Sarit Sass, Roy Shafir, and Jessica R. Cauchard. 2019. Collocated human-drone interaction: Methodology and approach strategy. In 14th ACM/IEEE International Conference on Human-Robot Inter-action (HRI'19) . 172-181. DOI: https://doi.org/10.1109/HRI.2019.8673127
xeno-canto. 2022. Sharing Bird Sounds from Around the World. Retrieved from https://xeno-canto.org/sounds/uploaded/IIGGEELDDD/XC527981-200215-153900.mp3
YABAI. 2022. Otohime: Using the Sound Princess to Hide Embarrassment. Retrieved from http://yabai.com/p/4177
Wataru Yamada, Hiroyuki Manabe, and Daizo Ikeda. 2019. ZeRONE: Safety drone with blade-free propulsion. In CHI Conference on Human Factors in Computing Systems (CHI'19) . Association for Computing Machinery, New York, NY, 1-8. DOI: https://doi.org/10.1145/3290605.3300595
Alexander Yeh, Photchara Ratsamee, Kiyoshi Kiyokawa, Yuki Uranishi, Tomohiro Mashita, Haruo Takemura, Morten Fjeld, and Mohammad Obaid. 2017. Exploring proxemics for human-drone interaction. In International Conference on Human-Agent Interaction (HAI'17) . Association for Computing Machinery, New York, NY, 81-88. DOI: https://doi.org/10.1145/3125739.3125773
Brian J. Zhang, Knut Peterson, Christopher A. Sanchez, and Naomi T. Fitter. 2021. Exploring consequential robot sound: Should we make robots quiet and kawaii-et? In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'21) . 3056-3062. DOI: https://doi.org/10.1109/IROS51168.2021.9636365
Brian J. Zhang, Nick Stargu, Samuel Brimhall, Lilian Chan, Jason Fick, and Naomi T. Fitter. 2021. Bringing WALL-E out of the silver screen: Understanding how transformative robot sound affects human perception. In IEEE International Conference on Robotics and Automation (ICRA'21) . 3801-3807. DOI: https://doi.org/10.1109/ICRA48506.2021.9562082
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In SIGCHI Conference on Human Factors in Computing Systems (CHI'07) . Association for Computing Machinery, New York, NY, 493-502. DOI: https://doi.org/10.1145/1240624.1240704