research-article

Public Access

AI-Mediated Communication: Language Use and Interpersonal Effects in a Referential Communication Task

Authors:

Hannah Mieczkowski,

Jeffrey T. Hancock,

Jess HohensteinAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 5, Issue CSCW1

Article No.: 17, Pages 1 - 14

https://doi.org/10.1145/3449091

Published: 22 April 2021 Publication History

Abstract

AI-Mediated Communication (AI-MC) is interpersonal communication that involves an artificially intelligent system that can modify, augment, or even generate content to achieve communicative and relational goals. AI-MC is increasingly involved in human communication and has the potential to impact core aspects of human communication, such as language production, interpersonal perception and task performance. Through a between-subjects experimental design we examine how these processes are influenced when integrating AI-generated language in the form of suggested text responses (Google's smart replies) into a text-based referential communication task. Our study replicates and extends the impacts of a positivity bias in AI-generated language and introduces the adjacency pair framework into the study of AI-MC. We also find preliminary yet mixed evidence to suggest that AI-generated language has the potential to undermine some dimensions of interpersonal perception, such as social attraction. This study contributes important concepts for future work in AI-MC and offers findings with implications for the design of AI systems in human-to-human communication.

References

[1]

2015. Email Statistics Report, 2015--2019. https://www.radicati.com/wp/wp-content/uploads/2015/02/Email-Statistics-Report-2015--2019-Executive-Summary.pdf

[2]

Kenneth C Arnold, Krysta Chauncey, and Krzysztof Z Gajos. 2018. Sentiment bias in predictive text recommendations results in biased writing. In Graphics Interface. 8--11.

[3]

Kenneth C Arnold, Krysta Chauncey, and Krzysztof Z Gajos. 2020. Predictive text encourages predictable writing. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 128--138.

Digital Library

[4]

Diane S Berry, JamesWPennebaker, Jennifer S Mueller, andWendy S Hiller. 1997. Linguistic bases of social perception. Personality and Social Psychology Bulletin 23, 5 (1997), 526--537.

[5]

Greg Bullock. 2017. Save time with Smart Reply in Gmail. https://www.blog.google/products/gmail/save-time-withsmart- reply-in-gmail/

[6]

Judee K Burgoon. 1993. Interpersonal expectations, expectancy violations, and emotional communication. Journal of Language and Social Psychology 12, 1--2 (1993), 30--48.

[7]

Herbert H Clark and Deanna Wilkes-Gibbs. 1986. Referring as a collaborative process. Cognition 22, 1 (1986), 1--39.

[8]

John H Connolly, Roel M Vismans, Christopher S Butler, and Richard A Gatward. 2011. Discourse and pragmatics in Functional Grammar. Vol. 18. Walter de Gruyter.

[9]

Cristian Danescu-Niculescu-Mizil, Michael Gamon, and Susan Dumais. 2011. Mark my words! Linguistic style accommodation in social media. In Proceedings of the 20th international conference on World wide web. 745--754.

Digital Library

[10]

Roy W Feinson. 1988. Interpretive tone telecommunication method and apparatus. US Patent 4,754,474.

[11]

Susan T Fiske, Juan Xu, Amy C Cuddy, and Peter Glick. 1999. (Dis) respecting versus (dis) liking: Status and interdependence predict ambivalent stereotypes of competence and warmth. Journal of social issues 55, 3 (1999), 473--489.

[12]

Pamela Gibbons, Jon Busch, and James J Bradac. 1991. Powerful versus powerless language: Consequences for persuasion, impression formation, and cognitive response. Journal of Language and Social Psychology 10, 2 (1991), 115--133.

[13]

Amy L Gonzales, Jeffrey T Hancock, and James W Pennebaker. 2010. Language style matching as a predictor of social dynamics in small groups. Communication Research 37, 1 (2010), 3--19.

[14]

Jeffrey T Hancock and Philip J Dunham. 2001. Language use in computer-mediated communication: The role of coordination devices. Discourse Processes 31, 1 (2001), 91--110.

[15]

Jeffrey T Hancock, Mor Naaman, and Karen Levy. 2020. AI-Mediated Communication: Definition, Research Agenda, and Ethical Considerations. Journal of Computer-Mediated Communication 25, 1 (2020), 89--100.

[16]

Matthew Henderson, Rami Al-Rfou, Brian Strope, Yun-Hsuan Sung, László Lukács, Ruiqi Guo, Sanjiv Kumar, Balint Miklos, and Ray Kurzweil. 2017. Efficient natural language response suggestion for smart reply. arXiv preprint arXiv:1705.00652 (2017).

[17]

Jess Hohenstein and Malte Jung. 2018. AI-Supported Messaging: An Investigation of Human-Human Text Conversation with AI Support. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1--6.

Digital Library

[18]

Jess Hohenstein and Malte Jung. 2020. AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust. Computers in Human Behavior 106 (2020), 106190.

Digital Library

[19]

Deborah Son Holoien and Susan T Fiske. 2013. Downplaying positive impressions: Compensation between warmth and competence in impression management. Journal of Experimental Social Psychology 49, 1 (2013), 33--41.

[20]

Clayton J Hutto and Eric Gilbert. 2014. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In Eighth international AAAI conference on weblogs and social media.

[21]

Maurice Jakesch, Megan French, Xiao Ma, Jeffrey T Hancock, and Mor Naaman. 2019. AI-Mediated Communication: How the Perception that Profile Text was Written by AI Affects Trustworthiness. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.

Digital Library

[22]

Emily Jamison and Iryna Gurevych. 2014. Adjacency Pair Recognition in Wikipedia Discussions using Lexical Pairs. In Proceedings of the 28th Pacific Asia Conference on Language, Information and Computing. 479--488.

[23]

Anjuli Kannan, Karol Kurach, Sujith Ravi, Tobias Kaufmann, Andrew Tomkins, Balint Miklos, Greg Corrado, Laszlo Lukacs, Marina Ganea, Peter Young, et al. 2016. Smart reply: Automated response suggestion for email. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 955--964.

Digital Library

[24]

James C McCroskey and Thomas A McCain. 1974. The measurement of interpersonal attraction. (1974).

[25]

Joseph Edward McGrath. 1984. Groups: Interaction and performance. Vol. 14. Prentice-Hall Englewood Cliffs, NJ.

[26]

James W Pennebaker, Ryan L Boyd, Kayla Jordan, and Kate Blackburn. 2015. The development and psychometric properties of LIWC2015. Technical Report.

[27]

Martin J Pickering and Simon Garrod. 2013. An integrated theory of language production and comprehension. Behavioral and brain sciences 36, 4 (2013), 329--347.

[28]

Emanuel A Schegloff and Harvey Sacks. 1973. Opening up closings. Semiotica 8, 4 (1973), 289--327.

[29]

Tom Simonite. 2020. As Machines Get Smarter, How Will We Relate to Them? https://www.wired.com/story/asmachines-get-smarter-how-will-we-relate-to-them/

[30]

Yue Weng, Huaixiu Zheng, Franziska Bell, and Gokhan Tur. 2019. OCC: A Smart Reply System for Efficient In-App Communications. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2596--2603.

Digital Library

Cited By

Mobo FInam AJoseph SAhmad MChemingui H(2024)Beyond the ScreenHyperautomation in Business and Society10.4018/979-8-3693-3354-9.ch014(266-285)Online publication date: 28-Jun-2024
https://doi.org/10.4018/979-8-3693-3354-9.ch014
Волкова АГрачев ИКостина ТЛарин СНоакк Н(2024)Experimental and model studies of the influence of AI on the evolution of collective consciousnessЦифровая экономика10.34706/DE-2024-03-05(38-44)Online publication date: 24-Sep-2024
https://doi.org/10.34706/DE-2024-03-05
Coman ACardon P(2024)Perceptions of Professionalism and Authenticity in AI-Assisted WritingBusiness and Professional Communication Quarterly10.1177/23294906241233224Online publication date: 11-Mar-2024
https://doi.org/10.1177/23294906241233224
Show More Cited By

Index Terms

AI-Mediated Communication: Language Use and Interpersonal Effects in a Referential Communication Task
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing

Recommendations

Show Me You Care: Trait Empathy, Linguistic Style, and Mimicry on Facebook
Special Issue on Affect and Interaction in Agent-based Systems and Social Media and Regular Paper

Linguistic mimicry, the adoption of another’s language patterns, is a subconscious behavior with pro-social benefits. However, some professions advocate its conscious use in empathic communication. This involves mutual mimicry; effective communicators ...
Affective Profile Pictures: Exploring the Effects of Changing Facial Expressions in Profile Pictures on Text-Based Communication
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

When receiving text messages from unacquainted colleagues in fully remote workplaces, insufficient mutual understanding and limited social cues can lead people to misinterpret the tone of the message and further influence their impression of remote ...
Impression transference from AI to human: The impact of AI's fairness on interpersonal perception in AI-Mediated communication
Highlights
- Quantitatively evidenced the impact of AI attributes on the perception of AI-related individuals.
- Examined the interpersonal dynamics in AI-MC from a hybrid human-AI group perspective.
- Employed the moderated mediation model to ...
Abstract
Artificial Intelligence-mediated communication (AI-MC) is a new form of communication where AI algorithms modify, augment, or generate messages for its human principal. However, little is known about how AI-MC influences impression formation and ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue CSCW1

CSCW

April 2021

5016 pages

EISSN:2573-0142

DOI:10.1145/3460939

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2021

Published in PACMHCI Volume 5, Issue CSCW1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
2,375
Total Downloads

Downloads (Last 12 months)1,209
Downloads (Last 6 weeks)150

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mobo FInam AJoseph SAhmad MChemingui H(2024)Beyond the ScreenHyperautomation in Business and Society10.4018/979-8-3693-3354-9.ch014(266-285)Online publication date: 28-Jun-2024
https://doi.org/10.4018/979-8-3693-3354-9.ch014
Волкова АГрачев ИКостина ТЛарин СНоакк Н(2024)Experimental and model studies of the influence of AI on the evolution of collective consciousnessЦифровая экономика10.34706/DE-2024-03-05(38-44)Online publication date: 24-Sep-2024
https://doi.org/10.34706/DE-2024-03-05
Coman ACardon P(2024)Perceptions of Professionalism and Authenticity in AI-Assisted WritingBusiness and Professional Communication Quarterly10.1177/23294906241233224Online publication date: 11-Mar-2024
https://doi.org/10.1177/23294906241233224
Yang ZXu XYao BRogers EZhang SIntille SShara NGao GWang D(2024)Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older AdultsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596258:2(1-35)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659625
Hwang ASiy JShelby RLentz A(2024)In Whose Voice?: Examining AI Agent Representation of People in Social Interaction through Generative SpeechProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661555(224-245)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661555
Dangol ANewman MWolfe RLee JKientz JYip JPitt C(2024)Mediating Culture: Cultivating Socio-cultural Understanding of AI in Children through Participatory DesignProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661515(1805-1822)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661515
Draxler FWerner ALehmann FHoppe MSchmidt ABuschek DWelsch R(2024)The AI Ghostwriter Effect: When Users do not Perceive Ownership of AI-Generated Text but Self-Declare as AuthorsACM Transactions on Computer-Human Interaction10.1145/363787531:2(1-40)Online publication date: 5-Feb-2024
https://dl.acm.org/doi/10.1145/3637875
Hu JGuo JTang NMa XYao YYang CXu Y(2024)Designing the Conversational Agent: Asking Follow-up Questions for Information ElicitationProceedings of the ACM on Human-Computer Interaction10.1145/36373208:CSCW1(1-30)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637320
Hada RHusain SGumma VDiddee HYadavalli ASeth AKulkarni NGadiraju UVashistha ASeshadri VBali K(2024)Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language TechnologyProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659017(1926-1939)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3659017
Kadoma KAubin Le Quere MFu XMunsch CMetaxa DNaaman M(2024)The Role of Inclusion, Control, and Ownership in Workplace AI-Mediated CommunicationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642650(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642650
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents