Source author record

Chi Ma

Chi Ma appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Machine Learning astro-ph.SR Computation and Language Computer Vision cond-mat.mes-hall cond-mat.str-el Distributed, Parallel, and Cluster Computing eess.IV

Catalog footprint

What is connected

4works

8topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2024arXiv

Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe

Pipeline parallelism is an essential technique in the training of large-scale Transformer models. However, it suffers from imbalanced memory consumption, leading to insufficient memory utilization. The BPipe technique was proposed to address this issue and has proven effective in the GPT-3 model. Nevertheless, our experiments have not yielded similar benefits for LLaMA training. Additionally, BPipe only yields negligible benefits for GPT-3 training when applying flash attention. We analyze the underlying causes of the divergent performance of BPipe on GPT-3 and LLaMA. Furthermore, we introduce a novel method to estimate the performance of BPipe.

preprint2021arXiv

Morphological Operation Residual Blocks: Enhancing 3D Morphological Feature Representation in Convolutional Neural Networks for Semantic Segmentation of Medical Images

The shapes and morphology of the organs and tissues are important prior knowledge in medical imaging recognition and segmentation. The morphological operation is a well-known method for morphological feature extraction. As the morphological operation is performed well in hand-crafted image segmentation techniques, it is also promising to design an approach to approximate morphological operation in the convolutional networks. However, using the traditional convolutional neural network as a black-box is usually hard to specify the morphological operation action. Here, we introduced a 3D morphological operation residual block to extract morphological features in end-to-end deep learning models for semantic segmentation. This study proposed a novel network block architecture that embedded the morphological operation as an infinitely strong prior in the convolutional neural network. Several 3D deep learning models with the proposed morphological operation block were built and compared in different medical imaging segmentation tasks. Experimental results showed the proposed network achieved a relatively higher performance in the segmentation tasks comparing with the conventional approach. In conclusion, the novel network block could be easily embedded in traditional networks and efficiently reinforce the deep learning models for medical imaging segmentation.

preprint2019arXiv

Quantum confinement and edge effects on electronic properties of zigzag green phosphorene nanoribbons

First principles density-functional theory calculations were performed to investigate quantum confinement and edge effects on the electronic properties of zigzag green phosphorene nanoribbons (ZGPNRs) with edge chemical species including H, OH, F, Cl, O, and S for the ribbons width in the range of 0.5 \~{} 3.7 nm. The ZGPNRs were obtained from the relaxed two-dimensional (2D) green phosphorene monolayer with different cutting strategies and the most energetically favorable ribbon configuration was selected for further exploration of the size and edge effects. It was found that the electronic properties of the ZGPNRs are strongly associated with the ribbon width and edge chemical species. They show either semiconducting or metallic features depending on the edge functionalization species. The ZGPNRs show semiconducting behavior with the edge species of H, OH, F, or Cl (Group \uppercase\expandafter{\romannumeral1}), while exhibit metallic characteristics with pristine or O, S edges (Group \uppercase\expandafter{\romannumeral2}). The conduction band minimum (CBM) and valence band maximum (VBM) of the ZGPNRs with the Group \uppercase\expandafter{\romannumeral1} edge are primarily located at the inner P atoms and the edge P and functionalization atoms have little contribution. However, for the Group \uppercase\expandafter{\romannumeral2} edge, the electronic bands crossing the Fermi level are dominantly contributed by the edge atoms. It was also found that the band gap and work function of the ZGPNRs are tunable by varying ribbon width and edge functionalization species.

preprint2010arXiv

Neutron-rich chromium isotope anomalies in supernova nanoparticles

Neutron-rich isotopes with masses near that of iron are produced in type Ia and II supernovae. Traces of such nucleosynthesis are found in primitive meteorites in the form of variations in the isotopic abundance of 54Cr, the most neutron-rich stable isotope of chromium. The hosts of these isotopic anomalies must be presolar grains that condensed in the outflows of supernovae, offering the opportunity to study the nucleosynthesis of iron-peak nuclei in ways that complement spectroscopic observations and can inform models of stellar evolution. However, despite almost two decades of extensive search, the carrier of 54Cr anomalies is still unknown, presumably because it is fine-grained and is chemically labile. Here we identify in the primitive meteorite Orgueil the carrier of 54Cr-anomalies as nanoparticles, most likely spinels that show large enrichments in 54Cr relative to solar composition (54Cr/52Cr ratio >3.6xsolar). Such large enrichments in 54Cr can only be produced in supernovae. The mineralogy of the grains supports condensation in the O/Ne-O/C zones of a type II supernova, although a type Ia origin cannot be excluded. We suggest that planetary materials incorporated different amounts of these nanoparticles, possibly due to late injection by a nearby supernova that also delivered 26Al and 60Fe to the solar system. This idea explains why the relative abundance of 54Cr and other neutron-rich isotopes vary between planets and meteorites. We anticipate that future isotopic studies of the grains identified here will shed new light on the birth of the solar system and the conditions insupernovae.