Source author record

Meng Du

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Artificial Intelligence Computation and Language Computer Vision Machine Learning Neurons and Cognition physics.soc-ph Social and Information Networks

Catalog footprint

Research overview

2works

7topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

Lonely individuals process the world in idiosyncratic ways

Loneliness is detrimental to well-being and is often accompanied by self-reported feelings of not being understood by others. What contributes to such feelings in lonely people? We used functional magnetic resonance imaging (fMRI) of 66 participants to unobtrusively measure the relative alignment of people's mental processing of naturalistic stimuli and tested whether or not lonely people actually process the world in idiosyncratic ways. We found evidence for such idiosyncrasy: lonely individuals' neural responses were dissimilar to their peers, particularly in regions of the default-mode network in which similar responses have been associated with shared perspectives and subjective understanding. These relationships persisted when controlling for demographic similarities, objective social isolation, and participants' friendships with each other. Our findings suggest the possibility that being surrounded by people who see the world differently from oneself, even if one is friends with them, may be a risk factor for loneliness.

preprint2022arXiv

VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers

Breakthroughs in transformer-based models have revolutionized not only the NLP field, but also vision and multimodal systems. However, although visualization and interpretability tools have become available for NLP models, internal mechanisms of vision and multimodal transformers remain largely opaque. With the success of these transformers, it is increasingly critical to understand their inner workings, as unraveling these black-boxes will lead to more capable and trustworthy models. To contribute to this quest, we propose VL-InterpreT, which provides novel interactive visualizations for interpreting the attentions and hidden representations in multimodal transformers. VL-InterpreT is a task agnostic and integrated tool that (1) tracks a variety of statistics in attention heads throughout all layers for both vision and language components, (2) visualizes cross-modal and intra-modal attentions through easily readable heatmaps, and (3) plots the hidden representations of vision and language tokens as they pass through the transformer layers. In this paper, we demonstrate the functionalities of VL-InterpreT through the analysis of KD-VLP, an end-to-end pretraining vision-language multimodal transformer-based model, in the tasks of Visual Commonsense Reasoning (VCR) and WebQA, two visual question answering benchmarks. Furthermore, we also present a few interesting findings about multimodal transformer behaviors that were learned through our tool.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.