AnswerThisView only
Shared answer · view only
VRShared by Vahid Rahimzadeh · Jul 26
LoginSign up
Science/How can we model different aspects of social intelligence (cognitive, situational, behavioral) in the social networks with and emphasize on the LLMs
How can we model different aspects of social intelligence (cognitive, situational, behavioral) in the social networks with and emphasize on the LLMs?
Used tools Searching academic papers for modeling social intelligence (cognitive, situational, behavioral) in social networks with emphasis on large language models (LLMs), found 82 papers

To model different aspects of social intelligence—cognitive, situational, and behavioral—in social networks, especially leveraging large language models (LLMs), a multidimensional and modular approach is needed. Below, I detail strategies and findings from the latest research, discussing relevant methods, challenges, and emergent best practices in each domain. Throughout, I will distinguish the three facets and highlight where LLMs currently excel, as well as where the literature points to gaps and future directions.


1. Cognitive Social Intelligence

Definition: Cognitive social intelligence involves abilities such as recognizing emotions, attributing intentions (Theory of Mind, ToM), empathy, and understanding social situations and roles.

Modeling Approaches:

  • Theory of Mind (ToM) Benchmarks: LLMs are being systematically evaluated on their ability to reason about others’ mental/emotional states using specialized benchmarks (e.g., ToMBench, ToMi, SocialIQa) covering emotion perception, intention attribution, and belief inference. These benchmarks reveal LLMs like GPT-4 approach, but do not match, human-level ToM performance, typically lagging behind by ~10% and struggling with nuanced, implicit social scenarios(Chen, 2024)(Sap, 2022)(Sclar, 2023)(Ma, 2023).
  • Empathy Assessment: Studies show that LLMs can demonstrate aspects of cognitive empathy, such as emotion recognition and emotionally supportive responses, especially in contexts like healthcare, although performance varies widely and is usually surface-level(Sorin, 2023)(Elyoseph, 2023).
  • Awareness Evaluation: New frameworks examine LLMs’ self-awareness, which is seen as a foundational trait for higher-level social cognition and trustworthiness(Li, 2024).

Implications for Social Networks: Embedding LLMs capable of cognitive social intelligence in platforms/users’ agents enables advanced moderation, context-adaptive recommendation, and more human-like digital interaction, but must be bounded by clear ethical guidelines due to current limitations in nuanced understanding(Vrins, 2024)(Street, 2024).


2. Situational Social Intelligence

Definition: This refers to the ability to assess, adapt, and respond appropriately to shifting social contexts, rules, and group dynamics within a network.

Modeling Approaches:

  • Standardized Contextual Evaluation: Newly proposed tests (like SESI) place LLMs in real-world, scenario-based evaluations to measure contextual adaptation—critical for tasks such as negotiation and conflict resolution. These studies consistently show that LLMs’ situational responses often default to superficial friendliness, and their “social IQ” is distinct from their academic intelligence(Xu, 2024)(Chen, 2024).
  • Multi-Agent and Role-Playing Environments: Multi-agent text-based simulations (e.g., SOTOPIA, RoleInteract, SocialAI School) create open-ended, role-specific, and context-shifting environments where LLMs interact as a group, requiring adaptation to changing social signals and group strategies. These allow assessment of both individual and collective situational intelligence, revealing that LLM behavior (and perceived intelligence) is sensitive to group composition and context(Kova, 2024)(Zhou, 2023)(Chen, 2024)(Chen, 2024).

Implications for Social Networks: By integrating LLM-driven situational modeling, social platforms can enable more dynamic moderation, adaptive content feeds, and simulated environments for user training or digital therapy; however, current LLMs require further enhancement to deal with ambiguous and shifting group norms.


3. Behavioral Social Intelligence

Definition: Encompasses the observable actions and adaptive behaviors within social contexts—such as communication, influence, cooperation, and decision-making within social networks.

Modeling Approaches:

  • Interaction Simulations: LLM-powered agents can be trained on both individual and group interaction frameworks to model phenomena like conformity, polarization, or prosocial behavior in synthetic social networks. For example, frameworks like CogMir deliberately model cognitive biases, including “prosocial irrationality,” to reflect more human-like group dynamics(Liu, 2024).
  • Policy and Response Generation: LLMs’ ability to generate and select context-appropriate actions, dialogue, or interventions is being evaluated for applications such as socially assistive robots, digital coaching, and customer service bots(Shi, 2024)(Vrins, 2024).
  • Transparency and Believability: Evidence suggests that behavioral trust and perception of social intelligence in LLM-driven agents improves with greater model transparency and explainability(Xu, 2023).
  • Social Signal Processing: Multimodal integration (text, voice, visual cues) is emerging as a crucial addition to LLM frameworks for capturing and generating meaningful behavioral cues, though existing systems are mostly text-based(Vinciarelli, 2011).

Implications for Social Networks: LLMs, deployed as moderators, conversation partners, or educators, can model and amplify positive social behaviors, cultivate inclusive environments, and simulate peer pressure or group support, with important caveats about alignment to human values and potential for system-level bias.


4. Integrative, Human-Inspired Approaches

  • Developmental and Psychological Insights: By incorporating concepts such as joint attention, scaffolding, and developmental trajectories from psychology, some recent frameworks (e.g., SocialAI School) allow for richer experimentation with LLMs in more naturalistic, culturally situated social settings(Kova, 2024).
  • Computational Social Science: As networked societies become more complex, LLM-driven computational models are being used for large-scale simulation and analysis of emergent social phenomena(Conte, 2012)(Vinciarelli, 2011).

5. Challenges and Future Directions

  • Distinct Social and Academic Intelligence: Research suggests social intelligence is a separable capability from LLMs’ linguistic or academic prowess(Xu, 2024).
  • Lack of Robust ToM and Contextual Depth: LLMs’ reasoning is brittle with abstract, indirect, or implicit social cues, and they often fail at in-depth theory-of-mind tasks(Sap, 2022)(Shapira, 2023).
  • Need for Benchmarks and Evaluation: New multi-scenario, multi-agent, and real-world simulation benchmarks are critically needed to drive progress.
  • Ethical, Fairness, and Safety Concerns: As LLMs mediate more social processes, transparent evaluation and mitigation of bias becomes paramount(Street, 2024)(Hadi, 2023).
  • Adaptation to Multimodal and Real-Time Data: Text-only models are limited in recognizing social signals—progress is needed toward integrating visual/audio cues for richer behavioral modeling(Vinciarelli, 2011).

In Summary (Table: Modeling Social Intelligence Aspects in LLMs)

AspectKey AbilitiesModeling ApproachesLimitationsKey Citations
CognitiveToM, emotion, empathyBenchmarks, empathy tests, self-awareness datasetsSurface-level, context brittleness(Chen, 2024), (Sorin, 2023), (Li, 2024)
SituationalContext, adaptation, rolesSESI, multi-agent envs (RoleInteract, SOTOPIA)Overfriendliness, context-switching(Xu, 2024), (Chen, 2024), (Zhou, 2023)
BehavioralInteraction, norms, influenceAgent sim, policy learning, multimodal inputLacks nonverbal cues, deep strategy(Liu, 2024), (Shi, 2024), (Vinciarelli, 2011)

Would you like me to dive deeper into evaluation methodologies for these LLM-based social intelligence agents, or focus on how to address current gaps—such as incorporating non-linguistic social signals or improving theory-of-mind capabilities? Or, would you like a survey of the most promising practical applications of these approaches in real-world social networks?

Save

Citation Lists

Rosaria Conte, Nigel Gilbert, Giulia Bonelli, Claudio CioffiRevilla, Guillaume Deffuant, Jnos Kertsz, Vittorio Loreto, Helen Susannah Moat, JeanPierre Nadal, ngel Snchez, Andrzej Nowak, Andreas Flache, M. San Miguel, D. Helbing · 2012-11-01 · Springer Science+Business Media

Yuan Li, Yue Huang, Lin Yu-Li, Siyuan Wu, Yao Wan, Lichao Sun · 2024-01-31 · Cornell University

Natalie Shapira, G. Zwirn, Yoav Goldberg · 2023-01-01 · None

Suggested next steps

Run a sensitivity analysisTurn this into a reportAnalyze an uploaded PDFEdit the draftExport the extraction table
TRY:
History

Loading sources…

Q1

How can we model different aspects of social intelligence (cognitive, situational, behavioral) in the social networks with and emphasize on the LLMs?

Abstract
Source 1: Manifesto of computational social science

Rosaria Conte, Nigel Gilbert, +12 · 2012 · Springer Science+Business Media · 401 citations

10.1140/epjst/e2012-01697-8

The increasing integration of technology into our lives has created unprecedented volumes data on society''s everyday behaviour. Such opens up exciting new opportunities to work towards a quantitative understanding complex social systems, within the realms discipline known as Computational Social Science. Against background financial crises, riots and international epidemics, urgent need for great…

Source 2: I Think, Therefore I am: Awareness in Large Language Models

Yuan Li, Yue Huang, +4 · 2024 · Cornell University · 1 citations

10.48550/arxiv.2401.17882

Do large language models (LLMs) exhibit any forms of awareness similar to humans? In this paper, we introduce the concept LLMs, arguing that is an essential aspect trustworthiness for LLMs enhance their interaction with humans while ensuring ethical responses. We define in as ability perceive and understand themselves AI social intelligence. identify four key dimensions awareness: capability, miss…

Source 3: How Well Do Large Language Models Perform on Faux Pas Tests?

Natalie Shapira, G. Zwirn, +1 · 2023 · 7 citations

10.18653/v1/2023.findings-acl.663

Motivated by the question of extent to which large language models "understand" social intelligence, we investigate ability such generate correct responses questions involving descriptions faux pas situations. The test is a used in clinical psychology, known be more challenging for children than individual tests theory-of-mind or intelligence. Our results demonstrate that, while seem sometimes off…

Source 4: SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents

Xuhui Zhou, Hao Zhu, +9 · 2023 · Cornell University · 1 citations

10.48550/arxiv.2310.11667

Humans are social beings; we pursue goals in our daily interactions, which is a crucial aspect of intelligence. Yet, AI systems'' abilities this realm remain elusive. We present SOTOPIA, an open-ended environment to simulate complex interactions between artificial agents and evaluate their In environment, role-play interact under wide variety scenarios; they coordinate, collaborate, exchange, comp…

Source 5: Academically intelligent LLMs are not necessarily socially intelligent

Ruoxi Xu, Hongyu Lin, +3 · 2024 · Cornell University · 1 citations

10.48550/arxiv.2403.06591

The academic intelligence of large language models (LLMs) has made remarkable progress in recent times, but their social performance remains unclear. Inspired by established human frameworks, particularly Daniel Goleman''s theory, we have developed a standardized test based on real-world scenarios to comprehensively assess the LLMs, termed as Situational Evaluation Social Intelligence (SESI). We c…

Source 6: Transparency Enhances Positive Perceptions of Social Artificial Intelligence

Ying Xu, Nora Bradford, +1 · 2023 · Wiley · 4 citations

10.1155/2023/5550418

Social chatbots are aimed at building emotional bonds with users, and thus it is particularly important to design these technologies so as elicit positive perceptions from users. In the current study, we investigate impacts that transparent explanations of chatbots mechanisms have on users chatbots. A total 914 participants were recruited Amazon Mechanical Turk. They randomly assigned observe conv…

Source 7: Large Language Models (LLMs) and Empathy A Systematic Review

Vera Sorin, Danna Brin, +5 · 2023 · Cold Spring Harbor Laboratory · 32 citations

10.1101/2023.08.07.23293769

Abstract Purpose Empathy, a cornerstone of human interaction, is unique quality to humans that Large Language Models (LLMs) are believed lack. Our study aims review the literature on capacity LLMs in demonstrating empathy Methods We conducted search MEDLINE up July 2023. Seven publications ultimately met inclusion criteria. Results All studies included this were published but one focused ChatGPT-3…

Source 8: Exploring Prosocial Irrationality for LLM Agents: A Social Cognition View

X. Liu, Jie Zhang, +4 · 2024 · Cornell University · 1 citations

10.48550/arxiv.2405.14744

Large language models (LLMs) have been shown to face hallucination issues due the data they trained on often containing human bias; whether this is reflected in decision-making process of LLM agents remains under-explored. As Agents are increasingly employed intricate social environments, a pressing and natural question emerges: Can leverage hallucinations mirror cognitive biases, thus exhibiting…

Source 9: Wizard-of-Oz vs. GPT-4: A Comparative Study of Perceived Social Intelligence in HRI Brainstorming

Anita Vrins, Ethel Pruss, +5 · 2024 · 6 citations

10.1145/3610978.3640755

Human-robot interaction often employs the Wizard-of-Oz (WoZ) paradigm, where a human controls robot. However, this approach has limitations, such as lack of autonomy that impedes real-world applications. Large language models (LLMs) can replace WoZ in conversational tasks, brainstorming. We propose that, application domains, LLM-controlled robots achieve comparable perceived social intelligence to…

Source 10: Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs

Maarten Sap, Ronan Le Bras, +2 · 2022 · 71 citations

10.18653/v1/2022.emnlp-main.248

Social intelligence and Theory of Mind (TOM), i.e., the ability to reason about different mental states, intents, reactions all people involved, allows humans effectively navigate understand everyday social interactions. As NLP systems are used in increasingly complex situations, their grasp dynamics becomes crucial.In this work, we examine open question modern from an empirical theorybased perspe…

21 sources · 0 selected
1 / 3