Researcher profile

Chi Ma

Chi Ma contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 15 - UnverifiedVerification L1Unclaimed author
3works
0followers
7topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2024arXiv

Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe

Pipeline parallelism is an essential technique in the training of large-scale Transformer models. However, it suffers from imbalanced memory consumption, leading to insufficient memory utilization. The BPipe technique was proposed to address this issue and has proven effective in the GPT-3 model. Nevertheless, our experiments have not yielded similar benefits for LLaMA training. Additionally, BPipe only yields negligible benefits for GPT-3 training when applying flash attention. We analyze the underlying causes of the divergent performance of BPipe on GPT-3 and LLaMA. Furthermore, we introduce a novel method to estimate the performance of BPipe.

preprint2021arXiv

Morphological Operation Residual Blocks: Enhancing 3D Morphological Feature Representation in Convolutional Neural Networks for Semantic Segmentation of Medical Images

The shapes and morphology of the organs and tissues are important prior knowledge in medical imaging recognition and segmentation. The morphological operation is a well-known method for morphological feature extraction. As the morphological operation is performed well in hand-crafted image segmentation techniques, it is also promising to design an approach to approximate morphological operation in the convolutional networks. However, using the traditional convolutional neural network as a black-box is usually hard to specify the morphological operation action. Here, we introduced a 3D morphological operation residual block to extract morphological features in end-to-end deep learning models for semantic segmentation. This study proposed a novel network block architecture that embedded the morphological operation as an infinitely strong prior in the convolutional neural network. Several 3D deep learning models with the proposed morphological operation block were built and compared in different medical imaging segmentation tasks. Experimental results showed the proposed network achieved a relatively higher performance in the segmentation tasks comparing with the conventional approach. In conclusion, the novel network block could be easily embedded in traditional networks and efficiently reinforce the deep learning models for medical imaging segmentation.

preprint2019arXiv

Quantum confinement and edge effects on electronic properties of zigzag green phosphorene nanoribbons

First principles density-functional theory calculations were performed to investigate quantum confinement and edge effects on the electronic properties of zigzag green phosphorene nanoribbons (ZGPNRs) with edge chemical species including H, OH, F, Cl, O, and S for the ribbons width in the range of 0.5 \~{} 3.7 nm. The ZGPNRs were obtained from the relaxed two-dimensional (2D) green phosphorene monolayer with different cutting strategies and the most energetically favorable ribbon configuration was selected for further exploration of the size and edge effects. It was found that the electronic properties of the ZGPNRs are strongly associated with the ribbon width and edge chemical species. They show either semiconducting or metallic features depending on the edge functionalization species. The ZGPNRs show semiconducting behavior with the edge species of H, OH, F, or Cl (Group \uppercase\expandafter{\romannumeral1}), while exhibit metallic characteristics with pristine or O, S edges (Group \uppercase\expandafter{\romannumeral2}). The conduction band minimum (CBM) and valence band maximum (VBM) of the ZGPNRs with the Group \uppercase\expandafter{\romannumeral1} edge are primarily located at the inner P atoms and the edge P and functionalization atoms have little contribution. However, for the Group \uppercase\expandafter{\romannumeral2} edge, the electronic bands crossing the Fermi level are dominantly contributed by the edge atoms. It was also found that the band gap and work function of the ZGPNRs are tunable by varying ribbon width and edge functionalization species.