Researcher profile

Xinyi Shen

Xinyi Shen contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 15 - UnverifiedVerification L1Unclaimed author
3works
0followers
5topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2022arXiv

PatchFormer: An Efficient Point Transformer with Patch Attention

The point cloud learning community witnesses a modeling shift from CNNs to Transformers, where pure Transformer architectures have achieved top accuracy on the major learning benchmarks. However, existing point Transformers are computationally expensive since they need to generate a large attention map, which has quadratic complexity (both in space and time) with respect to input size. To solve this shortcoming, we introduce Patch ATtention (PAT) to adaptively learn a much smaller set of bases upon which the attention maps are computed. By a weighted summation upon these bases, PAT not only captures the global shape context but also achieves linear complexity to input size. In addition, we propose a lightweight Multi-Scale aTtention (MST) block to build attentions among features of different scales, providing the model with multi-scale features. Equipped with the PAT and MST, we construct our neural architecture called PatchFormer that integrates both modules into a joint framework for point cloud learning. Extensive experiments demonstrate that our network achieves comparable accuracy on general point cloud learning tasks with 9.2x speed-up than previous point Transformers.

preprint2022arXiv

PVT: Point-Voxel Transformer for Point Cloud Learning

The recently developed pure Transformer architectures have attained promising accuracy on point cloud learning benchmarks compared to convolutional neural networks. However, existing point cloud Transformers are computationally expensive since they waste a significant amount of time on structuring the irregular data. To solve this shortcoming, we present Sparse Window Attention (SWA) module to gather coarse-grained local features from non-empty voxels, which not only bypasses the expensive irregular data structuring and invalid empty voxel computation, but also obtains linear computational complexity with respect to voxel resolution. Meanwhile, to gather fine-grained features about the global shape, we introduce relative attention (RA) module, a more robust self-attention variant for rigid transformations of objects. Equipped with the SWA and RA, we construct our neural architecture called PVT that integrates both modules into a joint framework for point cloud learning. Compared with previous Transformer-based and attention-based models, our method attains top accuracy of 94.0% on classification benchmark and 10x inference speedup on average. Extensive experiments also valid the effectiveness of PVT on part and semantic segmentation benchmarks (86.6% and 69.2% mIoU, respectively).

preprint2020arXiv

Quantifying socioeconomic activities and weather effects on the global spread of COVID-19 epidemic

The COVID-19 has caused more than three million infections and over two hundred thousand deaths by April 20201. Limiting socioeconomic activities (SA) is among the most adopted governmental mitigating efforts to combat the transmission of the virus, though the degree varies dramatically among different regimes2. This study aims to quantify the contribution from the SA and weather conditions to the transmission of COVID-19 at global scale. Ruling out the unobservable factors including medical facilities and other control policies (MOC) through region-by-time fixed effects3,4, we show that the limiting SA has a leading contribution to lower the reproductive number by 18.3%, while weather conditions, including ultraviolet, relative humidity, and wind explain a smaller amount of variation. Temperature might have a non-monotonic impact on the transmission. We further show that in developed countries5 and China, the SA effect is more pronounced whereas the weather effect is significantly downplayed possibly because people tend to stay indoors most of the time with a controlled climate. We finally estimate the reduced reproductive number and the population spared from infections due to restricting SA at 40,964, 180,336, 174,494, in China, United States, and Europe respectively. From late January to mid-April, all regions, except for China, Australia, and south Korea show a steep upward trend of spared infections due to restricting SA. US and Europe, in particular, show far steeper upward trends of spared infections in the analyzed timeframe, signaling a greater risk of reopening the economy too soon.