Source author record

Meng Du

Meng Du appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

2works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

2 published item(s)

preprint2022arXiv

Lonely individuals process the world in idiosyncratic ways

Loneliness is detrimental to well-being and is often accompanied by self-reported feelings of not being understood by others. What contributes to such feelings in lonely people? We used functional magnetic resonance imaging (fMRI) of 66 participants to unobtrusively measure the relative alignment of people's mental processing of naturalistic stimuli and tested whether or not lonely people actually process the world in idiosyncratic ways. We found evidence for such idiosyncrasy: lonely individuals' neural responses were dissimilar to their peers, particularly in regions of the default-mode network in which similar responses have been associated with shared perspectives and subjective understanding. These relationships persisted when controlling for demographic similarities, objective social isolation, and participants' friendships with each other. Our findings suggest the possibility that being surrounded by people who see the world differently from oneself, even if one is friends with them, may be a risk factor for loneliness.

preprint2022arXiv

VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers

Breakthroughs in transformer-based models have revolutionized not only the NLP field, but also vision and multimodal systems. However, although visualization and interpretability tools have become available for NLP models, internal mechanisms of vision and multimodal transformers remain largely opaque. With the success of these transformers, it is increasingly critical to understand their inner workings, as unraveling these black-boxes will lead to more capable and trustworthy models. To contribute to this quest, we propose VL-InterpreT, which provides novel interactive visualizations for interpreting the attentions and hidden representations in multimodal transformers. VL-InterpreT is a task agnostic and integrated tool that (1) tracks a variety of statistics in attention heads throughout all layers for both vision and language components, (2) visualizes cross-modal and intra-modal attentions through easily readable heatmaps, and (3) plots the hidden representations of vision and language tokens as they pass through the transformer layers. In this paper, we demonstrate the functionalities of VL-InterpreT through the analysis of KD-VLP, an end-to-end pretraining vision-language multimodal transformer-based model, in the tasks of Visual Commonsense Reasoning (VCR) and WebQA, two visual question answering benchmarks. Furthermore, we also present a few interesting findings about multimodal transformer behaviors that were learned through our tool.