Catalog footprint

What is connected

200works
75topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

200 published item(s)

preprint2026arXiv

AcademiClaw: When Students Set Challenges for AI Agents

Benchmarks within the OpenClaw ecosystem have thus far evaluated exclusively assistant-level tasks, leaving the academic-level capabilities of OpenClaw largely unexamined. We introduce AcademiClaw, a bilingual benchmark of 80 complex, long-horizon tasks sourced directly from university students' real academic workflows -- homework, research projects, competitions, and personal projects -- that they found current AI agents unable to solve effectively. Curated from 230 student-submitted candidates through rigorous expert review, the final task set spans 25+ professional domains, ranging from olympiad-level mathematics and linguistics problems to GPU-intensive reinforcement learning and full-stack system debugging, with 16 tasks requiring CUDA GPU execution. Each task executes in an isolated Docker sandbox and is scored on task completion by multi-dimensional rubrics combining six complementary techniques, with an independent five-category safety audit providing additional behavioral analysis. Experiments on six frontier models show that even the best achieves only a 55\% pass rate. Further analysis uncovers sharp capability boundaries across task domains, divergent behavioral strategies among models, and a disconnect between token consumption and output quality, providing fine-grained diagnostic signals beyond what aggregate metrics reveal. We hope that AcademiClaw and its open-sourced data and code can serve as a useful resource for the OpenClaw community, driving progress toward agents that are more capable and versatile across the full breadth of real-world academic demands. All data and code are available at https://github.com/GAIR-NLP/AcademiClaw.

preprint2026arXiv

AirQualityBench: A Realistic Evaluation Benchmark for Global Air Quality Forecasting

Air-quality forecasting models are commonly evaluated on regional, preprocessed, and normalized datasets, where missing observations are removed or artificially completed. Such protocols simplify comparison but hide the conditions that dominate real monitoring networks: uneven global coverage, structured missingness, heterogeneous pollutant scales, and deployment cost. We introduce \textbf{AirQualityBench}, a global multi-pollutant benchmark designed to evaluate forecasting models under these realistic conditions. The benchmark contains hourly observations from 3,720 monitoring stations over 2021--2025, covers six major pollutants, and preserves provider-native observation masks. Rather than imputing a dense data tensor, AirQualityBench exposes missingness as part of the forecasting problem and reports errors on valid future observations after inverse transformation to physical concentration scales. Evaluating representative spatio-temporal models under this unified protocol shows that strong performance on sanitized datasets does not reliably transfer to global, fragmented monitoring streams. AirQualityBench therefore serves as a realistic testbed for scalable, mask-aware, and physically interpretable air-quality forecasting. All benchmark data, code, evaluation scripts, and baseline implementations are available at \href{https://github.com/Star-Learning/AirQualityBench}{GitHub}.

preprint2026arXiv

Boosting In-Silicon Directed Evolution with Fine-Tuned Protein Language Model and Tree Search

Protein evolution through amino acid mutations is a cornerstone of life sciences. Recent advances in protein language models have shown rich evolutionary patterns, offering unprecedented potential for in-silicon directed evolution. However, existing directed evolution methods largely rely on heuristic evolution strategies and have yet to efficiently integrate the transformative protein language models with advanced optimization techniques, such as reinforcement learning, to adaptively learn superior evolution policies. To bridge this gap, we propose AlphaDE, a novel framework that evolves protein sequences by harnessing the innovative paradigms of large language models, such as fine-tuning and test-time inference. First, AlphaDE fine-tunes pretrained protein language models using masked language modeling on homologous protein sequences to activate the evolutionary plausibility of the interested protein family. Second, AlphaDE introduces test-time inference based on Monte Carlo tree search, which effectively evolves proteins with evolutionary guidance from the fine-tuned protein language model. Extensive benchmark experiments show that AlphaDE remarkably outperforms previous state-of-the-art methods even with few-shot fine-tuning. A case study further demonstrates that AlphaDE supports condensing the protein sequence space of avGFP through computational evolution.

preprint2026arXiv

Channel Estimation for RIS-Assisted mmWave Systems via Diffusion Models

Reconfigurable intelligent surface (RIS) has been recognized as a promising technology for next-generation wireless communications. However, the performance of RIS-assisted systems critically depends on accurate channel state information (CSI). To address this challenge, this letter proposes a novel channel estimation method for RIS-aided millimeter-wave (mmWave) systems based on diffusion models (DMs). Specifically, the forward diffusion process of the original signal is formulated to model the received signal as a noisy observation within the framework of DMs. Subsequently, the channel estimation task is formulated as the reverse diffusion process, and a sampling algorithm based on denoising diffusion implicit models (DDIMs) is developed to enable effective inference. Furthermore, a lightweight neural network, termed BRCNet, is introduced to replace the conventional U-Net, significantly reducing the number of parameters and computational complexity. Extensive experiments conducted under various scenarios demonstrate that the proposed method consistently outperforms existing baselines.

preprint2026arXiv

Improving Database Performance by Application-side Transaction Merging

This paper explores a new opportunity to improve the performance of transaction processing at the application side by merging structurely similar statements or transactions. Concretely, we re-write transactions to 1) merge similar statements using specific SQL semantics; 2) eliminate redundant reads; and 3) merge contending statements across transactions by pre-computing their aggregated effect. Following this idea, we present the design of TransactionMerger, a middleware to collect and merge transactions across different clients. We further present a static analysis tool to identify the merging opportunity without violating isolation as well as our experience of re-writing transactions in TPC-C and Spree, a popular real-world application. Our evaluation shows that such transaction merging can improve TPC-C throughput by up to 2.65X and Spree throughput by 3.52X.

preprint2026arXiv

Long-term Monitoring of Kernel and Hardware Events to Understand Latency Variance

This paper presents our experience to understand latency variance caused by kernel and hardware events, which are often invisible at the application level. For this purpose, we have built VarMRI, a tool chain to monitor and analyze those events in the long term. To mitigate the "big data" problem caused by long-term monitoring, VarMRI selectively records a subset of events following two principles: it only records events that are affecting the requests recorded by the application; it records coarse-grained information first and records additional information only when necessary. Furthermore, VarMRI introduces an analysis method that is efficient on large amount of data, robust on different data set and against missing data, and informative to the user. VarMRI has helped us to carry out a 3,000-hour study of six applications and benchmarks on CloudLab. It reveals a wide variety of events causing latency variance, including interrupt preemption, Java GC, pipeline stall, NUMA balancing etc.; simple optimization or tuning can reduce tail latencies by up to 31%. Furthermore, the impacts of some of these events vary significantly across different experiments, which confirms the necessity of long-term monitoring.

preprint2026arXiv

PADE: A Predictor-Free Sparse Attention Accelerator via Unified Execution and Stage Fusion

Attention-based models have revolutionized AI, but the quadratic cost of self-attention incurs severe computational and memory overhead. Sparse attention methods alleviate this by skipping low-relevance token pairs. However, current approaches lack practicality due to the heavy expense of added sparsity predictor, which severely drops their hardware efficiency. This paper advances the state-of-the-art (SOTA) by proposing a bit-serial enable stage-fusion (BSF) mechanism, which eliminates the need for a separate predictor. However, it faces key challenges: 1) Inaccurate bit-sliced sparsity speculation leads to incorrect pruning; 2) Hardware under-utilization due to fine-grained and imbalanced bit-level workloads. 3) Tiling difficulty caused by the row-wise dependency in sparsity pruning criteria. We propose PADE, a predictor-free algorithm-hardware co-design for dynamic sparse attention acceleration. PADE features three key innovations: 1) Bit-wise uncertainty interval-enabled guard filtering (BUI-GF) strategy to accurately identify trivial tokens during each bit round; 2) Bidirectional sparsity-based out-of-order execution (BS-OOE) to improve hardware utilization; 3) Interleaving-based sparsity-tiled attention (ISTA) to reduce both I/O and computational complexity. These techniques, combined with custom accelerator designs, enable practical sparsity acceleration without relying on an added sparsity predictor. Extensive experiments on 22 benchmarks show that PADE achieves 7.43x speed up and 31.1x higher energy efficiency than Nvidia H100 GPU. Compared to SOTA accelerators, PADE achieves 5.1x, 4.3x and 3.4x energy saving than Sanger, DOTA and SOFA.

preprint2026arXiv

PC2P: Multi-Agent Path Finding via Personalized-Enhanced Communication and Crowd Perception

Distributed Multi-Agent Path Finding (MAPF) integrated with Multi-Agent Reinforcement Learning (MARL) has emerged as a prominent research focus, enabling real-time cooperative decision-making in partially observable environments through inter-agent communication. However, due to insufficient collaborative and perceptual capabilities, existing methods are inadequate for scaling across diverse environmental conditions. To address these challenges, we propose PC2P, a novel distributed MAPF method derived from a Q-learning-based MARL framework. Initially, we introduce a personalized-enhanced communication mechanism based on dynamic graph topology, which ascertains the core aspects of ``who" and ``what" in interactive process through three-stage operations: selection, generation, and aggregation. Concurrently, we incorporate local crowd perception to enrich agents' heuristic observation, thereby strengthening the model's guidance for effective actions via the integration of static spatial constraints and dynamic occupancy changes. To resolve extreme deadlock issues, we propose a region-based deadlock-breaking strategy that leverages expert guidance to implement efficient coordination within confined areas. Experimental results demonstrate that PC2P achieves superior performance compared to state-of-the-art distributed MAPF methods in varied environments. Ablation studies further confirm the effectiveness of each module for overall performance.

preprint2026arXiv

ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation

Long-horizon robotic manipulation requires dense feedback that reflects how a task advances through its procedural stages, not merely whether the final outcome is successful. Existing reward models often rely on trajectory-level success labels or time-based interpolation, which can conflate elapsed time with true task progress and therefore fail to capture unfinished steps, stagnation, and failure states. We present ProcVLM, a progress-aware vision-language model that learns procedure-grounded progress as a dense reward signal for manipulation. Rather than deriving progress from terminal outcomes or temporal proxies, ProcVLM grounds progress estimation in procedural structure and intra-stage visual change, and further adopts a reasoning-before-estimation paradigm that infers the remaining atomic actions before estimating task progress. Specifically, we construct this supervision by synthesizing frame-level subtask-semantic annotations, assigning progress budgets according to subtask structure, and distributing each budget based on intra-subtask visual change. To train ProcVLM at scale, we build a standardized procedural supervision synthesis pipeline and construct ProcCorpus-60M from 30 embodied datasets with 60M annotated frames, from which we derive ProcVQA for procedure-aware pretraining, with progress estimation as the central task alongside action segmentation and future planning. Experiments on ProcVQA and reward-model benchmarks show that ProcVLM improves embodied procedural reasoning and yields more discriminative trajectory-internal progress estimates than representative baselines, supporting its use as a dense reward model for downstream reward-guided policy optimization. Project page: https://procvlm.github.io/

preprint2026arXiv

Resilient AI Supercomputer Networking using MRC and SRv6

Tail latency dominates the performance of synchronous pretraining jobs when running at very large scales. We describe a three-pronged approach: (1) a new RDMA-based transport protocol, MRC, sprays across many paths and actively load-balances between them, eliminating the issue of flow collisions (2) the use of multi-plane Clos topologies to get the benefits of high switch radix and redundancy, allowing training clusters well over 100K GPUs to be built as two-tier topologies while increasing physical redundancy, and (3) the use of static source-routing using SRv6 to allow MRC the freedom to bypass failures by itself. We describe our experiences running MRC and static SRv6 routing in production in OpenAI and Microsoft's largest training clusters, where it has been used to train the latest frontier models. We demonstrate how MRC allows AI training jobs to ride out many network failures that previously would have interrupted training.

preprint2026arXiv

ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs

The decline of global shellfish biodiversity poses a severe threat to coastal ecosystems. Although artificial intelligence (AI) technologies show potential for automated ecological monitoring, existing marine benthic datasets often lack adaptation to the complexities of real underwater environments (e.g., variable lighting conditions and diverse species postures), posing challenges for the robust generalization of vision models in practical ecological monitoring. To address this problem, we construct ShellfishNet, a comprehensive image benchmark dataset designed specifically for real-world ecological monitoring constraints. Comprising 8,691 images across 32 taxa, this dataset includes a curated subset annotated with descriptive captions. It is constructed through field photography and web scraping, encompassing samples from complex real-world environments. Based on this benchmark, we systematically evaluate 80 representative neural network models, including Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), State Space Models (SSMs), and Self-Supervised Learning (SSL) methods. Furthermore, we evaluate the performance of fine-grained visual categorization (FGVC) models and investigate the image captioning capabilities of several mainstream multimodal large language models (MLLMs). Meanwhile, we introduce image corruption benchmark tests to simulate common underwater degradation scenarios (turbidity, severe weather) and assess the robustness of vision models, enabling trustworthy decisions on ecological protection in the wild. ShellfishNet is dedicated to providing a data foundation and a model-evaluation benchmark for the intelligent monitoring of benthic organisms.

preprint2025arXiv

Ultrahigh-Energy Gamma-ray Emission Associated with Black Hole-Jet Systems

Black holes (BH), one of the most intriguing objects in the universe, can manifest themselves through electromagnetic radiation initiated by the accretion flow. Some stellar-mass BHs drive relativistic jets when accreting matter from their companion stars, forming microquasars. Non-thermal emission from the radio to tera-electronvolt (TeV) gamma-ray band has been observed from microquasars, indicating the acceleration of relativistic particles. Here we report detection of four microquasars (SS 433, V4641 Sgr, GRS 1915+105, MAXI J1820+070) of spectrum extending to the ultrahigh-energy (UHE; photon energy $E>100$ TeV) band and one microquasar (Cygnus X-1) of spectrum approaching 100 TeV, using the Large High Altitude Air Shower Observatory (LHAASO). Notably, the total emission associated with SS 433 cannot be interpreted with a single leptonic component. In the UHE band, its emission is in spatial coincidence with a giant atomic cloud, which is consistent with a hadronic origin. An elongated source is discovered from V4641 Sgr with the spectrum continuing up to 800 TeV. The detection of UHE gamma rays demonstrates that accreting BHs and their environments can operate as extremely efficient accelerators of particles out of 1 peta-electronvolt (PeV), suggesting microquasars to be important contributors to Galactic cosmic rays especially around the `knee' region.

preprint2024arXiv

Lightweight Adaptive Feature De-drifting for Compressed Image Classification

JPEG is a widely used compression scheme to efficiently reduce the volume of transmitted images. The artifacts appear among blocks due to the information loss, which not only affects the quality of images but also harms the subsequent high-level tasks in terms of feature drifting. High-level vision models trained on high-quality images will suffer performance degradation when dealing with compressed images, especially on mobile devices. Numerous learning-based JPEG artifact removal methods have been proposed to handle visual artifacts. However, it is not an ideal choice to use these JPEG artifact removal methods as a pre-processing for compressed image classification for the following reasons: 1. These methods are designed for human vision rather than high-level vision models; 2. These methods are not efficient enough to serve as pre-processing on resource-constrained devices. To address these issues, this paper proposes a novel lightweight AFD module to boost the performance of pre-trained image classification models when facing compressed images. First, a FDE-Net is devised to generate the spatial-wise FDM in the DCT domain. Next, the estimated FDM is transmitted to the FE-Net to generate the mapping relationship between degraded features and corresponding high-quality features. A simple but effective RepConv block equipped with structural re-parameterization is utilized in FE-Net, which enriches feature representation in the training phase while maintaining efficiency in the deployment phase. After training on limited compressed images, the AFD-Module can serve as a "plug-and-play" model for pre-trained classification models to improve their performance on compressed images. Experiments demonstrate that our proposed AFD module can comprehensively improve the accuracy of the pre-trained classification models and significantly outperform the existing methods.

preprint2024arXiv

Open Set Dandelion Network for IoT Intrusion Detection

As IoT devices become widely, it is crucial to protect them from malicious intrusions. However, the data scarcity of IoT limits the applicability of traditional intrusion detection methods, which are highly data-dependent. To address this, in this paper we propose the Open-Set Dandelion Network (OSDN) based on unsupervised heterogeneous domain adaptation in an open-set manner. The OSDN model performs intrusion knowledge transfer from the knowledge-rich source network intrusion domain to facilitate more accurate intrusion detection for the data-scarce target IoT intrusion domain. Under the open-set setting, it can also detect newly-emerged target domain intrusions that are not observed in the source domain. To achieve this, the OSDN model forms the source domain into a dandelion-like feature space in which each intrusion category is compactly grouped and different intrusion categories are separated, i.e., simultaneously emphasising inter-category separability and intra-category compactness. The dandelion-based target membership mechanism then forms the target dandelion. Then, the dandelion angular separation mechanism achieves better inter-category separability, and the dandelion embedding alignment mechanism further aligns both dandelions in a finer manner. To promote intra-category compactness, the discriminating sampled dandelion mechanism is used. Assisted by the intrusion classifier trained using both known and generated unknown intrusion knowledge, a semantic dandelion correction mechanism emphasises easily-confused categories and guides better inter-category separability. Holistically, these mechanisms form the OSDN model that effectively performs intrusion knowledge transfer to benefit IoT intrusion detection. Comprehensive experiments on several intrusion datasets verify the effectiveness of the OSDN model, outperforming three state-of-the-art baseline methods by 16.9%.

preprint2023arXiv

Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

In this paper, we tackle the problem of domain shift. Most existing methods perform training on multiple source domains using a single model, and the same trained model is used on all unseen target domains. Such solutions are sub-optimal as each target domain exhibits its own specialty, which is not adapted. Furthermore, expecting single-model training to learn extensive knowledge from multiple source domains is counterintuitive. The model is more biased toward learning only domain-invariant features and may result in negative knowledge transfer. In this work, we propose a novel framework for unsupervised test-time adaptation, which is formulated as a knowledge distillation process to address domain shift. Specifically, we incorporate Mixture-of-Experts (MoE) as teachers, where each expert is separately trained on different source domains to maximize their specialty. Given a test-time target domain, a small set of unlabeled data is sampled to query the knowledge from MoE. As the source domains are correlated to the target domains, a transformer-based aggregator then combines the domain knowledge by examining the interconnection among them. The output is treated as a supervision signal to adapt a student prediction network toward the target domain. We further employ meta-learning to enforce the aggregator to distill positive knowledge and the student network to achieve fast adaptation. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art and validates the effectiveness of each proposed component. Our code is available at https://github.com/n3il666/Meta-DMoE.

preprint2022arXiv

\textsc{The Three Hundred} project: The \textsc{Gizmo-Simba} run

We introduce \textsc{Gizmo-Simba}, a new suite of galaxy cluster simulations within \textsc{The Three Hundred} project. \textsc{The Three Hundred} consists of zoom re-simulations of 324 clusters with $M_{200}\gtrsim 10^{14.8}M_\odot$ drawn from the MultiDark-Planck $N$-body simulation, run using several hydrodynamic and semi-analytic codes. The \textsc{Gizmo-Simba} suite adds a state-of-the-art galaxy formation model based on the highly successful {\sc Simba} simulation, mildly re-calibrated to match $z=0$ cluster stellar properties. Comparing to \textsc{The Three Hundred} zooms run with \textsc{Gadget-X}, we find intrinsic differences in the evolution of the stellar and gas mass fractions, BCG ages, and galaxy colour-magnitude diagrams, with \textsc{Gizmo-Simba} generally providing a good match to available data at $z \approx 0$. \textsc{Gizmo-Simba}'s unique black hole growth and feedback model yields agreement with the observed BH scaling relations at the intermediate-mass range and predicts a slightly different slope at high masses where few observations currently lie. \textsc{Gizmo-Simba} provides a new and novel platform to elucidate the co-evolution of galaxies, gas, and black holes within the densest cosmic environments.

preprint2022arXiv

"It's A Blessing and A Curse": Unpacking Creators' Practices with Non-Fungible Tokens (NFTs) and Their Communities

NFTs (Non-Fungible Tokens) are blockchain-based cryptographic tokens to represent ownership of unique content such as images, videos, or 3D objects. Despite NFTs' increasing popularity and skyrocketing trading prices, little is known about people's perceptions of and experiences with NFTs. In this work, we focus on NFT creators and present results of an exploratory qualitative study in which we interviewed 15 NFT creators from nine different countries. Our participants had nuanced feelings about NFTs and their communities. We found that most of our participants were enthusiastic about the underlying technologies and how they empower individuals to express their creativity and pursue new business models of content creation. Our participants also gave kudos to the NFT communities that have supported them to learn, collaborate, and grow in their NFT endeavors. However, these positivities were juxtaposed by their accounts of the many challenges that they encountered and thorny issues that the NFT ecosystem is grappling with around ownership of digital content, low-quality NFTs, scams, possible money laundering, and regulations. We discuss how the built-in properties (e.g., decentralization) of blockchains and NFTs might have contributed to some of these issues. We present design implications on how to improve the NFT ecosystem (e.g., making NFTs even more accessible to newcomers and the broader population).

preprint2022arXiv

A rate of convergence of Physics Informed Neural Networks for the linear second order elliptic PDEs

In recent years, physical informed neural networks (PINNs) have been shown to be a powerful tool for solving PDEs empirically. However, numerical analysis of PINNs is still missing. In this paper, we prove the convergence rate to PINNs for the second order elliptic equations with Dirichlet boundary condition, by establishing the upper bounds on the number of training samples, depth and width of the deep neural networks to achieve desired accuracy. The error of PINNs is decomposed into approximation error and statistical error, where the approximation error is given in $C^2$ norm with $\mathrm{ReLU}^{3}$ networks (deep network with activations function $\max\{0,x^3\}$) and the statistical error is estimated by Rademacher complexity. We derive the bound on the Rademacher complexity of the non-Lipschitz composition of gradient norm with $\mathrm{ReLU}^{3}$ network, which is of immense independent interest.

preprint2022arXiv

A self-contained and self-explanatory DNA storage system

Current research on DNA storage usually focuses on the improvement of storage density by developing effective encoding and decoding schemes while lacking the consideration on the uncertainty in ultra-long-term data storage and retention. Consequently, the current DNA storage systems are often not self-contained, implying that they have to resort to external tools for the restoration of the stored DNA data. This may result in high risks in data loss since the required tools might not be available due to the high uncertainty in far future. To address this issue, we propose in this paper a self-contained DNA storage system that can bring self-explanatory to its stored data without relying on any external tool. To this end, we design a specific DNA file format whereby a separate storage scheme is developed to reduce the data redundancy while an effective indexing is designed for random read operations to the stored data file. We verified through experimental data that the proposed self-contained and self-explanatory method can not only get rid of the reliance on external tools for data restoration but also minimise the data redundancy brought about when the amount of data to be stored reaches a certain scale.

preprint2022arXiv

A stochastic model to reproduce the star-formation history of individual galaxies in hydrodynamic simulations

The star formation history (SFH) of galaxies is critical for understanding galaxy evolution. Hydrodynamical simulations enable us to precisely reconstruct the SFH of galaxies and establish a link to the underlying physical processes. In this work, we present a model to describe individual galaxies' SFHs from three simulations: TheThreeHundred, Illustris-1 and TNG100-1. This model divides the galaxy SFH into two distinct components: the "main sequence" and the "variation". The "main sequence" part is generated by tracing the history of the $SFR-M_*$ main sequence of galaxies across time. The "variation" part consists of the scatter around the main sequence, which is reproduced by fractional Brownian motions. We find that: 1) The evolution of the main sequence varies between simulations; 2) fractional Brownian motions can reproduce many features of SFHs, however, discrepancies still exist; 3) The variations and mass-loss rate are crucial for reconstructing the SFHs of the simulations. This model provides a fair description of the SFHs in simulations. On the other hand, by correlating the fractional Brownian motion model to simulation data, we provide a 'standard' against which to compare simulations.

preprint2022arXiv

Ab initio Approaches to High Entropy Alloys: A Comparison of CPA, SQS, and Supercell Methods

We present a comparative study of different modeling approaches to the electronic properties of the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy. Common to our modeling is the methodology to compute the one-particle Green's function in the framework of density functional theory. We demonstrate that the special quasi-random structures modeling and the supercell, i.e. the locally self-consistent multiple-scatering methods provide very similar results for the ground state properties such as the spectral function (density of states) and the equilibrium lattice parameter. To reconcile the multiple-scattering single-site coherent potential approximation with the real space supercell methods, we included the effect of screening of the net charges of the alloy components. Based on the analysis of the total energy and spectral functions computed within the density functional theory, we found no signature for the long-range or local magnetic moments formation in the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy, instead we find possible superconductivity below $\sim 9$K.

preprint2022arXiv

An error analysis of generative adversarial networks for learning distributions

This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined through Hölder classes, including the Wasserstein distance as a special case. We also show that GANs are able to adaptively learn data distributions with low-dimensional structures or have Hölder densities, when the network architectures are chosen properly. In particular, for distributions concentrated around a low-dimensional set, we show that the learning rates of GANs do not depend on the high ambient dimension, but on the lower intrinsic dimension. Our analysis is based on a new oracle inequality decomposing the estimation error into the generator and discriminator approximation error and the statistical error, which may be of independent interest.

preprint2022arXiv

Analysis of A New Adaptive Time Filter Algorithm for The Unsteady Stokes/Darcy Model

In this report, we propose a new adaptive time filter algorithm for the unsteady Stokes/Darcy model. First we present a first order $θ$-scheme with the variable time step which is one parameter family of Linear Multi-step methods and use a time filter algorithm to increase the convergence order to second order with almost no increasing the amount of computation. Furthermore, we construct coupled and decoupled adaptive algorithms. Then we analyze stabilities and the second-order accuracy of variable time-stepping algorithm for Linear Multi-step methods plus time filter, respectively. Finally, we use two numerical experiments to verify theoretical results including effectiveness, convergence and efficiency with adaptive method.

preprint2022arXiv

BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster

Most AI projects start with a Python notebook running on a single laptop; however, one usually needs to go through a mountain of pains to scale it to handle larger dataset (for both experimentation and production deployment). These usually entail many manual and error-prone steps for the data scientists to fully take advantage of the available hardware resources (e.g., SIMD instructions, multi-processing, quantization, memory allocation optimization, data partitioning, distributed computing, etc.). To address this challenge, we have open sourced BigDL 2.0 at https://github.com/intel-analytics/BigDL/ under Apache 2.0 license (combining the original BigDL and Analytics Zoo projects); using BigDL 2.0, users can simply build conventional Python notebooks on their laptops (with possible AutoML support), which can then be transparently accelerated on a single node (with up-to 9.6x speedup in our experiments), and seamlessly scaled out to a large cluster (across several hundreds servers in real-world use cases). BigDL 2.0 has already been adopted by many real-world users (such as Mastercard, Burger King, Inspur, etc.) in production.

preprint2022arXiv

Breaking the Rate-Loss Bound of Quantum Key Distribution with Asynchronous Two-Photon Interference

Twin-field quantum key distribution can overcome the secret key capacity of repeaterless quantum key distribution via single-photon interference. However, to compensate for the channel fluctuations and lock the laser fluctuations, the techniques of phase tracking and phase locking are indispensable in experiment, which drastically increase experimental complexity and hinder free-space realization. Inspired by the duality in entanglement, we herein present an asynchronous measurement-device-independent quantum key distribution protocol that can surpass the secret key capacity even without phase tracking and phase locking. Leveraging the concept of time multiplexing, asynchronous two-photon Bell-state measurement is realized by postmatching two interference detection events. For a 1 GHz system, the new protocol reaches a transmission distance of 450 km without phase tracking. After further removing phase locking, our protocol is still capable of breaking the capacity at 270 km. Intriguingly, when using the same experimental techniques, our protocol has a higher key rate than the phase-matching-type twin-field protocol. In the presence of imperfect intensity modulation, it also has a significant advantage in terms of the transmission distance over the sending-or-not-sending type twin-field protocol. With high key rates and accessible technology, our work provides a promising candidate for practical scalable quantum communication networks.

preprint2022arXiv

Connectedness and local cut points of generalized Sierpinski carpets

We investigate a homeomorphism problem on a class of self-similar sets called generalized Sierpinski carpets (or shortly GSCs). It follows from two well-known results by Hata and Whyburn that a connected GSC is homeomorphic to the standard Sierpinski carpet if and only if it has no local cut points. On the one hand, we show that to determine whether a given GSC is connected, it suffices to iterate the initial pattern twice. On the other hand, we obtain two criteria: (1) for a connected GSC to have cut points, (2) for a connected GSC with no cut points to have local cut points. With these two criteria, we characterize all GSCs that are homeomorphic to the standard Sierpinski carpet. Our results on cut points and local cut points hold for Baranski carpets, too. Moreover, we extend the connectedness result to Baranski sponges. Thus, we also characterize when a Baranski carpet is homeomorphic to the standard GSC.

preprint2022arXiv

De-biased Representation Learning for Fairness with Unreliable Labels

Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes correlate with labels. Existing works proposed to inject the label information into the learning procedure to overcome such issues. However, the assumption that the observed labels are clean is not always met. In fact, label bias is acknowledged as the primary source inducing discrimination. In other words, the fair pre-processing methods ignore the discrimination encoded in the labels either during the learning procedure or the evaluation stage. This contradiction puts a question mark on the fairness of the learned representations. To circumvent this issue, we explore the following question: \emph{Can we learn fair representations predictable to latent ideal fair labels given only access to unreliable labels?} In this work, we propose a \textbf{D}e-\textbf{B}iased \textbf{R}epresentation Learning for \textbf{F}airness (DBRF) framework which disentangles the sensitive information from non-sensitive attributes whilst keeping the learned representations predictable to ideal fair labels rather than observed biased ones. We formulate the de-biased learning framework through information-theoretic concepts such as mutual information and information bottleneck. The core concept is that DBRF advocates not to use unreliable labels for supervision when sensitive information benefits the prediction of unreliable labels. Experiment results over both synthetic and real-world data demonstrate that DBRF effectively learns de-biased representations towards ideal labels.

preprint2022arXiv

DECORE: Deep Compression with Reinforcement Learning

Deep learning has become an increasingly popular and powerful methodology for modern pattern recognition systems. However, many deep neural networks have millions or billions of parameters, making them untenable for real-world applications due to constraints on memory size or latency requirements. As a result, efficient network compression techniques are often required for the widespread adoption of deep learning methods. We present DECORE, a reinforcement learning-based approach to automate the network compression process. DECORE assigns an agent to each channel in the network along with a light policy gradient method to learn which neurons or channels to be kept or removed. Each agent in the network has just one parameter (keep or drop) to learn, which leads to a much faster training process compared to existing approaches. DECORE provides state-of-the-art compression results on various network architectures and various datasets. For example, on the ResNet-110 architecture, it achieves a 64.8% compression and 61.8% FLOPs reduction as compared to the baseline model without any accuracy loss on the CIFAR-10 dataset. It can reduce the size of regular architectures like the VGG network by up to 99% with just a small accuracy drop of 2.28%. For a larger dataset like ImageNet with just 30 epochs of training, it can compress the ResNet-50 architecture by 44.7% and reduce FLOPs by 42.3%, with just a 0.69% drop on Top-5 accuracy of the uncompressed model. We also demonstrate that DECORE can be used to search for compressed network architectures based on various constraints, such as memory and FLOPs.

preprint2022arXiv

Delayed Impact of Interdisciplinary Research

Interdisciplinary research increasingly fuels innovation, and is considered to be a key to tomorrow breakthrough. Yet little is known about whether interdisciplinary research manifests delayed impact. Here, we use the time to reach the citation peak to quantify the highest impact time and citation dynamics, and examine its relationship with interdisciplinarity. Using large scale publication datasets, our results suggest that interdisciplinary papers show significant delayed impact both microscopically per paper and macroscopically collectively, as it takes longer time for interdisciplinary papers to reach their citation peak. Furthermore, we study the underlying forces of such delayed impact, finding that the effect goes beyond the Matthew effect (i.e., the rich-get-richer effect). Finally, we find that team size and content conventionality only partly account for this effect. Overall, our results suggest that governments, research administrators, funding agencies should be aware of this general feature of interdisciplinary science, which may have broad policy implications.

preprint2022arXiv

Experimental quantum advantage with quantum coupon collector

An increasing number of communication and computational schemes with quantum advantages have recently been proposed, which implies that quantum technology has fertile application prospects. However, demonstrating these schemes experimentally continues to be a central challenge because of the difficulty in preparing high-dimensional states or highly entangled states. In this study, we introduce and analyse a quantum coupon collector protocol by employing coherent states and simple linear optical elements, which was successfully demonstrated using realistic experimental equipment. We showed that our protocol can significantly reduce the number of samples needed to learn a specific set compared with the classical limit of the coupon collector problem. We also discuss the potential values and expansions of the quantum coupon collector by constructing a quantum blind box game. The information transmitted by the proposed game also broke the classical limit. These results strongly prove the advantages of quantum mechanics in machine learning and communication complexity.

preprint2022arXiv

Exploring Security Practices of Smart Contract Developers

Smart contracts are self-executing programs that run on blockchains (e.g., Ethereum). 680 million US dollars worth of digital assets controlled by smart contracts have been hacked or stolen due to various security vulnerabilities in 2021. Although security is a fundamental concern for smart contracts, it is unclear how smart contract developers approach security. To help fill this research gap, we conducted an exploratory qualitative study consisting of a semi-structured interview and a code review task with 29 smart contract developers with diverse backgrounds, including 10 early stage (less than one year of experience) and 19 experienced (2-5 years of experience) smart contract developers. Our findings show a wide range of smart contract security perceptions and practices including various tools and resources they used. Our early-stage developer participants had a much lower success rate (15%) of identifying security vulnerabilities in the code review task than their experienced counterparts (55%). Our hierarchical task analysis of their code reviews implies that just by accessing standard documentation, reference implementations and security tools is not sufficient. Many developers checked those materials or used a security tool but still failed to identify the security issues. In addition, several participants pointed out shortcomings of current smart contract security tooling such as its usability. We discuss how future education and tools could better support developers in ensuring smart contract security.

preprint2022arXiv

Giant and Reversible Electronic Structure Evolution in a Magnetic Topological Material EuCd2As2

The electronic structure and the physical properties of quantum materials can be significantly altered by charge carrier doping and magnetic state transition. Here we report a discovery of a giant and reversible electronic structure evolution with doping in a magnetic topological material. By performing high-resolution angle-resolved photoemission measurements on EuCd2As2,we found that a huge amount of hole doping can be introduced into the sample surface due to surface absorption. The electronic structure exhibits a dramatic change with the hole doping which can not be described by a rigid band shift. Prominent band splitting is observed at high doping which corresponds to a doping-induced magnetic transition at low temperature (below -15 K) from an antiferromagnetic state to a ferromagnetic state. These results have established a detailed electronic phase diagram of EuCd2As2 where the electronic structure and the magnetic structure change systematically and dramatically with the doping level. They further suggest that the transport, magnetic and topological properties of EuCd2As2 can be greatly modified by doping. These work will stimulate further investigations to explore for new phenomena and properties in doping this magnetic topological material.

preprint2022arXiv

GLD-Net: Improving Monaural Speech Enhancement by Learning Global and Local Dependency Features with GLD Block

For monaural speech enhancement, contextual information is important for accurate speech estimation. However, commonly used convolution neural networks (CNNs) are weak in capturing temporal contexts since they only build blocks that process one local neighborhood at a time. To address this problem, we learn from human auditory perception to introduce a two-stage trainable reasoning mechanism, referred as global-local dependency (GLD) block. GLD blocks capture long-term dependency of time-frequency bins both in global level and local level from the noisy spectrogram to help detecting correlations among speech part, noise part, and whole noisy input. What is more, we conduct a monaural speech enhancement network called GLD-Net, which adopts encoder-decoder architecture and consists of speech object branch, interference branch, and global noisy branch. The extracted speech feature at global-level and local-level are efficiently reasoned and aggregated in each of the branches. We compare the proposed GLD-Net with existing state-of-art methods on WSJ0 and DEMAND dataset. The results show that GLD-Net outperforms the state-of-the-art methods in terms of PESQ and STOI.

preprint2022arXiv

Grasping Core Rules of Time Series through Pure Models

Time series underwent the transition from statistics to deep learning, as did many other machine learning fields. Although it appears that the accuracy has been increasing as the model is updated in a number of publicly available datasets, it typically only increases the scale by several times in exchange for a slight difference in accuracy. Through this experiment, we point out a different line of thinking, time series, especially long-term forecasting, may differ from other fields. It is not necessary to use extensive and complex models to grasp all aspects of time series, but to use pure models to grasp the core rules of time series changes. With this simple but effective idea, we created PureTS, a network with three pure linear layers that achieved state-of-the-art in 80% of the long sequence prediction tasks while being nearly the lightest model and having the fastest running speed. On this basis, we discuss the potential of pure linear layers in both phenomena and essence. The ability to understand the core law contributes to the high precision of long-distance prediction, and reasonable fluctuation prevents it from distorting the curve in multi-step prediction like mainstream deep learning models, which is summarized as a pure linear neural network that avoids over-fluctuating. Finally, we suggest the fundamental design standards for lightweight long-step time series tasks: input and output should try to have the same dimension, and the structure avoids fragmentation and complex operations.

preprint2022arXiv

Improving Visual Speech Enhancement Network by Learning Audio-visual Affinity with Multi-head Attention

Audio-visual speech enhancement system is regarded as one of promising solutions for isolating and enhancing speech of desired speaker. Typical methods focus on predicting clean speech spectrum via a naive convolution neural network based encoder-decoder architecture, and these methods a) are not adequate to use data fully, b) are unable to effectively balance audio-visual features. The proposed model alleviates these drawbacks by a) applying a model that fuses audio and visual features layer by layer in encoding phase, and that feeds fused audio-visual features to each corresponding decoder layer, and more importantly, b) introducing a 2-stage multi-head cross attention (MHCA) mechanism to infer audio-visual speech enhancement for balancing the fused audio-visual features and eliminating irrelevant features. This paper proposes attentional audio-visual multi-layer feature fusion model, in which MHCA units are applied to feature mapping at every layer of decoder. The proposed model demonstrates the superior performance of the network against the state-of-the-art models.

preprint2022arXiv

Instance Image Retrieval by Learning Purely From Within the Dataset

Quality feature representation is key to instance image retrieval. To attain it, existing methods usually resort to a deep model pre-trained on benchmark datasets or even fine-tune the model with a task-dependent labelled auxiliary dataset. Although achieving promising results, this approach is restricted by two issues: 1) the domain gap between benchmark datasets and the dataset of a given retrieval task; 2) the required auxiliary dataset cannot be readily obtained. In light of this situation, this work looks into a different approach which has not been well investigated for instance image retrieval previously: {can we learn feature representation \textit{specific to} a given retrieval task in order to achieve excellent retrieval?} Our finding is encouraging. By adding an object proposal generator to generate image regions for self-supervised learning, the investigated approach can successfully learn feature representation specific to a given dataset for retrieval. This representation can be made even more effective by boosting it with image similarity information mined from the dataset. As experimentally validated, such a simple ``self-supervised learning + self-boosting'' approach can well compete with the relevant state-of-the-art retrieval methods. Ablation study is conducted to show the appealing properties of this approach and its limitation on generalisation across datasets.

preprint2022arXiv

Large-scale full-programmable quantum walk and its applications

With photonics, the quantum computational advantage has been demonstrated on the task of boson sampling. Next, developing quantum-enhanced approaches for practical problems becomes one of the top priorities for photonic systems. Quantum walks are powerful kernels for developing new and useful quantum algorithms. Here we realize large-scale quantum walks using a fully programmable photonic quantum computing system. The system integrates a silicon quantum photonic chip, enabling the simulation of quantum walk dynamics on graphs with up to 400 vertices and possessing full programmability over quantum walk parameters, including the particle property, initial state, graph structure, and evolution time. In the 400-dimensional Hilbert space, the average fidelity of random entangled quantum states after the whole on-chip circuit evolution reaches as high as 94.29$\pm$1.28$\%$. With the system, we demonstrated exponentially faster hitting and quadratically faster mixing performance of quantum walks over classical random walks, achieving more than two orders of magnitude of enhancement in the experimental hitting efficiency and almost half of the reduction in the experimental evolution time for mixing. We utilize the system to implement a series of quantum applications, including measuring the centrality of scale-free networks, searching targets on Erdös-Rényi networks, distinguishing non-isomorphic graph pairs, and simulating the topological phase of higher-order topological insulators. Our work shows one feasible path for quantum photonics to address applications of practical interests in the near future.

preprint2022arXiv

Learning Resolution-Adaptive Representations for Cross-Resolution Person Re-Identification

The cross-resolution person re-identification (CRReID) problem aims to match low-resolution (LR) query identity images against high resolution (HR) gallery images. It is a challenging and practical problem since the query images often suffer from resolution degradation due to the different capturing conditions from real-world cameras. To address this problem, state-of-the-art (SOTA) solutions either learn the resolution-invariant representation or adopt super-resolution (SR) module to recover the missing information from the LR query. This paper explores an alternative SR-free paradigm to directly compare HR and LR images via a dynamic metric, which is adaptive to the resolution of a query image. We realize this idea by learning resolution-adaptive representations for cross-resolution comparison. Specifically, we propose two resolution-adaptive mechanisms. The first one disentangles the resolution-specific information into different sub-vectors in the penultimate layer of the deep neural networks, and thus creates a varying-length representation. To better extract resolution-dependent information, we further propose to learn resolution-adaptive masks for intermediate residual feature blocks. A novel progressive learning strategy is proposed to train those masks properly. These two mechanisms are combined to boost the performance of CRReID. Experimental results show that the proposed method is superior to existing approaches and achieves SOTA performance on multiple CRReID benchmarks.

preprint2022arXiv

MIX-RS: A Multi-indexing System based on HDFS for Remote Sensing Data Storage

A large volume of remote sensing (RS) data has been generated with the deployment of satellite technologies. The data facilitates research in ecological monitoring, land management and desertification, etc. The characteristics of RS data (e.g., enormous volume, large single-file size and demanding requirement of fault tolerance) make the Hadoop Distributed File System (HDFS) an ideal choice for RS data storage as it is efficient, scalable and equipped with a data replication mechanism for failure resilience. To use RS data, one of the most important techniques is geospatial indexing. However, the large data volume makes it time-consuming to efficiently construct and leverage. Considering that most modern geospatial data centres are equipped with HDFS-based big data processing infrastructures, deploying multiple geospatial indices becomes natural to optimise the efficacy. Moreover, because of the reliability introduced by high-quality hardware and the infrequently modified property of the RS data, the use of multi-indexing will not cause large overhead. Therefore, we design a framework called Multi-IndeXing-RS (MIX-RS) that unifies the multi-indexing mechanism on top of the HDFS with data replication enabled for both fault tolerance and geospatial indexing efficiency. Given the fault tolerance provided by the HDFS, RS data is structurally stored inside for faster geospatial indexing. Additionally, multi-indexing enhances efficiency. The proposed technique naturally sits on top of the HDFS to form a holistic framework without incurring severe overhead or sophisticated system implementation efforts. The MIX-RS framework is implemented and evaluated using real remote sensing data provided by the Chinese Academy of Sciences, demonstrating excellent geospatial indexing performance.

preprint2022arXiv

On Private Online Convex Optimization: Optimal Algorithms in $\ell_p$-Geometry and High Dimensional Contextual Bandits

Differentially private (DP) stochastic convex optimization (SCO) is ubiquitous in trustworthy machine learning algorithm design. This paper studies the DP-SCO problem with streaming data sampled from a distribution and arrives sequentially. We also consider the continual release model where parameters related to private information are updated and released upon each new data, often known as the online algorithms. Despite that numerous algorithms have been developed to achieve the optimal excess risks in different $\ell_p$ norm geometries, yet none of the existing ones can be adapted to the streaming and continual release setting. To address such a challenge as the online convex optimization with privacy protection, we propose a private variant of online Frank-Wolfe algorithm with recursive gradients for variance reduction to update and reveal the parameters upon each data. Combined with the adaptive differential privacy analysis, our online algorithm achieves in linear time the optimal excess risk when $1<p\leq 2$ and the state-of-the-art excess risk meeting the non-private lower ones when $2<p\leq\infty$. Our algorithm can also be extended to the case $p=1$ to achieve nearly dimension-independent excess risk. While previous variance reduction results on recursive gradient have theoretical guarantee only in the independent and identically distributed sample setting, we establish such a guarantee in a non-stationary setting. To demonstrate the virtues of our method, we design the first DP algorithm for high-dimensional generalized linear bandits with logarithmic regret. Comparative experiments with a variety of DP-SCO and DP-Bandit algorithms exhibit the efficacy and utility of the proposed algorithms.

preprint2022arXiv

PackCache: An Online Cost-driven Data Caching Algorithm in the Cloud

In this paper, we study a data caching problem in the cloud environment, where multiple frequently co-utilised data items could be packed as a single item being transferred to serve a sequence of data requests dynamically with reduced cost. To this end, we propose an online algorithm with respect to a homogeneous cost model, called PackCache, that can leverage the FP-Tree technique to mine those frequently co-utilised data items for packing whereby the incoming requests could be cost-effectively served online by exploiting the concept of anticipatory caching. We show the algorithm is 2αcompetitive, reaching the lower bound of the competitive ratio for any deterministic online algorithm on the studied caching problem, and also time and space efficient to serve the requests. Finally, we evaluate the performance of the algorithm via experimental studies to show its actual cost-effectiveness and scalability.

preprint2022arXiv

PECCO: A Profit and Cost-oriented Computation Offloading Scheme in Edge-Cloud Environment with Improved Moth-flame Optimisation

With the fast growing quantity of data generated by smart devices and the exponential surge of processing demand in the Internet of Things (IoT) era, the resource-rich cloud centres have been utilised to tackle these challenges. To relieve the burden on cloud centres, edge-cloud computation offloading becomes a promising solution since shortening the proximity between the data source and the computation by offloading computation tasks from the cloud to edge devices can improve performance and Quality of Service (QoS). Several optimisation models of edge-cloud computation offloading have been proposed that take computation costs and heterogeneous communication costs into account. However, several important factors are not jointly considered, such as heterogeneities of tasks, load balancing among nodes and the profit yielded by computation tasks, which lead to the profit and cost-oriented computation offloading optimisation model PECCO proposed in this paper. Considering that the model is hard in nature and the optimisation objective is not differentiable, we propose an improved Moth-flame optimiser PECCO-MFI which addresses some deficiencies of the original Moth-flame Optimiser and integrate it under the edge-cloud environment. Comprehensive experiments are conducted to verify the superior performance of the proposed method when optimising the proposed task offloading model under the edge-cloud environment.

preprint2022arXiv

Performance Analysis of OMP in Super-Resolution

Given a spectrally sparse signal $\mathbf{y} = \sum_{i=1}^s x_i\mathbf{f}(τ_i) \in \mathbb{C}^{2n+1}$ consisting of $s$ complex sinusoids, we consider the super-resolution problem, which is about estimating frequency components $\{τ_i\}_{i=1}^s$ of $\mathbf y$. We consider the OMP-type algorithms for super-resolution, which is more efficient than other approaches based on Semi-Definite Programming. Our analysis shows that a two-stage algorithm with OMP initialization can recover frequency components under the separation condition $nΔ\gtrsim \text{dyn}(\mathbf{x})$ and the dependency on $\text{dyn}(\mathbf{x})$ is inevitable for the vanilla OMP algorithm. We further show that the Sliding-OMP algorithm, a variant of the OMP algorithm with an additional refinement step at each iteration, is provable to recover $\{τ_i\}_{i=1}^s$ under the separation condition $nΔ\geq c$. Moreover, our result can be extended to an incomplete measurement model with $O( s^2\log n)$ measurements.

preprint2022arXiv

Revealing room temperature ferromagnetism in exfoliated Fe$_5$GeTe$_2$ flakes with quantum magnetic imaging

Van der Waals material Fe$_5$GeTe$_2$, with its long-range ferromagnetic ordering near room temperature, has significant potential to become an enabling platform for implementing novel spintronic and quantum devices. To pave the way for applications, it is crucial to determine the magnetic properties when the thickness of Fe5GeTe2 reaches the few-layers regime. However, this is highly challenging due to the need for a characterization technique that is local, highly sensitive, artifact-free, and operational with minimal fabrication. Prior studies have indicated that Curie temperature TC can reach up to close to room temperature for exfoliated Fe$_5$GeTe$_2$ flakes, as measured via electrical transport; there is a need to validate these results with a measurement that reveals magnetism more directly. In this work, we investigate the magnetic properties of exfoliated thin flakes of van der Waals magnet Fe$_5$GeTe$_2$ via a quantum magnetic imaging technique based on nitrogen vacancy diamond. Through imaging the stray fields, we confirm room-temperature magnetic order in Fe$_5$GeTe$_2$ thin flakes with thickness down to 7 units cell. The stray field patterns and their response to magnetizing fields with different polarities point to a perpendicular easy-axis anisotropy. Furthermore, we perform imaging at different temperatures and determine the Curie temperature of the flakes at Tc~300 K. These results provide the basis for realizing a room-temperature monolayer ferromagnet with Fe$_5$GeTe$_2$. This work also demonstrates that the imaging technique enables a rapid screening of multiple flakes simultaneously, thereby paving the way towards high throughput characterization of potential 2D magnets near room temperature.

preprint2022arXiv

Self-supervised Spatiotemporal Representation Learning by Exploiting Video Continuity

Recent self-supervised video representation learning methods have found significant success by exploring essential properties of videos, e.g. speed, temporal order, etc. This work exploits an essential yet under-explored property of videos, the video continuity, to obtain supervision signals for self-supervised representation learning. Specifically, we formulate three novel continuity-related pretext tasks, i.e. continuity justification, discontinuity localization, and missing section approximation, that jointly supervise a shared backbone for video representation learning. This self-supervision approach, termed as Continuity Perception Network (CPNet), solves the three tasks altogether and encourages the backbone network to learn local and long-ranged motion and context representations. It outperforms prior arts on multiple downstream tasks, such as action recognition, video retrieval, and action localization. Additionally, the video continuity can be complementary to other coarse-grained video properties for representation learning, and integrating the proposed pretext task to prior arts can yield much performance gains.

preprint2022arXiv

Sensitivity tests of cosmic velocity fields to massive neutrinos

We investigate impacts of massive neutrinos on the cosmic velocity fields, employing high-resolution cosmological $N$-body simulations provided by the information-optimized CUBE code, where cosmic neutrinos are evolved using collisionless hydrodynamics and their perturbations can be accurately resolved. In this study we focus, for the first time, on the analysis of massive-neutrino induced suppression effects in various cosmic velocity field components of velocity magnitude, divergence, vorticity and dispersion. By varying the neutrino mass sum $M_ν$ from 0 -- 0.4 eV, the simulations show that, the power spectra of vorticity -- exclusively sourced by non-linear structure formation that is affected by massive neutrinos significantly -- is very sensitive to the mass sum, which potentially provide novel signatures in detecting massive neutrinos. Furthermore, using the chi-square statistic, we quantitatively test the sensitivity of the density and velocity power spectra to the neutrino mass sum. Indeed, we find that, the vorticity spectrum has the highest sensitivity, and the null hypothesis of massless neutrinos is incompatible with both vorticity and divergence spectra from $M_ν=0.1$ eV at high significance ($p$-value $= 0.03$ and $0.07$, respectively). These results demonstrate clearly the importance of peculiar velocity field measurements, in particular of vorticity and divergence components, in determination of neutrino mass and mass hierarchy.

preprint2022arXiv

SHREC'22 Track: Sketch-Based 3D Shape Retrieval in the Wild

Sketch-based 3D shape retrieval (SBSR) is an important yet challenging task, which has drawn more and more attention in recent years. Existing approaches address the problem in a restricted setting, without appropriately simulating real application scenarios. To mimic the realistic setting, in this track, we adopt large-scale sketches drawn by amateurs of different levels of drawing skills, as well as a variety of 3D shapes including not only CAD models but also models scanned from real objects. We define two SBSR tasks and construct two benchmarks consisting of more than 46,000 CAD models, 1,700 realistic models, and 145,000 sketches in total. Four teams participated in this track and submitted 15 runs for the two tasks, evaluated by 7 commonly-adopted metrics. We hope that, the benchmarks, the comparative results, and the open-sourced evaluation code will foster future research in this direction among the 3D object retrieval community.

preprint2022arXiv

Spatio-Temporal Self-Attention Network for Video Saliency Prediction

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed local spacetime according to its kernel size, while human attention is always attracted by relational visual features at different time. To overcome this limitation, we propose a novel Spatio-Temporal Self-Attention 3D Network (STSANet) for video saliency prediction, in which multiple Spatio-Temporal Self-Attention (STSA) modules are employed at different levels of 3D convolutional backbone to directly capture long-range relations between spatio-temporal features of different time steps. Besides, we propose an Attentional Multi-Scale Fusion (AMSF) module to integrate multi-level features with the perception of context in semantic and spatio-temporal subspaces. Extensive experiments demonstrate the contributions of key components of our method, and the results on DHF1K, Hollywood-2, UCF, and DIEM benchmark datasets clearly prove the superiority of the proposed model compared with all state-of-the-art models.

preprint2022arXiv

Switchable Online Knowledge Distillation

Online Knowledge Distillation (OKD) improves the involved models by reciprocally exploiting the difference between teacher and student. Several crucial bottlenecks over the gap between them -- e.g., Why and when does a large gap harm the performance, especially for student? How to quantify the gap between teacher and student? -- have received limited formal study. In this paper, we propose Switchable Online Knowledge Distillation (SwitOKD), to answer these questions. Instead of focusing on the accuracy gap at test phase by the existing arts, the core idea of SwitOKD is to adaptively calibrate the gap at training phase, namely distillation gap, via a switching strategy between two modes -- expert mode (pause the teacher while keep the student learning) and learning mode (restart the teacher). To possess an appropriate distillation gap, we further devise an adaptive switching threshold, which provides a formal criterion as to when to switch to learning mode or expert mode, and thus improves the student's performance. Meanwhile, the teacher benefits from our adaptive switching threshold and keeps basically on a par with other online arts. We further extend SwitOKD to multiple networks with two basis topologies. Finally, extensive experiments and analysis validate the merits of SwitOKD for classification over the state-of-the-arts. Our code is available at https://github.com/hfutqian/SwitOKD.

preprint2022arXiv

Test suite effectiveness metric evaluation: what do we know and what should we do?

Comparing test suite effectiveness metrics has always been a research hotspot. However, prior studies have different conclusions or even contradict each other for comparing different test suite effectiveness metrics. The problem we found most troubling to our community is that researchers tend to oversimplify the description of the ground truth they use. For example, a common expression is that "we studied the correlation between real faults and the metric to evaluate (MTE)". However, the meaning of "real faults" is not clear-cut. As a result, there is a need to scrutinize the meaning of "real faults". Without this, it will be half-knowledgeable with the conclusions. To tackle this challenge, we propose a framework ASSENT (evAluating teSt Suite EffectiveNess meTrics) to guide the follow-up research. In nature, ASSENT consists of three fundamental components: ground truth, benchmark test suites, and agreement indicator. First, materialize the ground truth for determining the real order in effectiveness among test suites. Second, generate a set of benchmark test suites and derive their ground truth order in effectiveness. Third, for the benchmark test suites, generate the MTE order in effectiveness by the metric to evaluate (MTE). Finally, calculate the agreement indicator between the two orders. Under ASSENT, we are able to compare the accuracy of different test suite effectiveness metrics. We apply ASSENT to evaluate representative test suite effectiveness metrics, including mutation score metrics and code coverage metrics. Our results show that, based on the real faults, mutation score and subsuming mutation score are the best metrics to quantify test suite effectiveness. Meanwhile, by using mutants instead of real faults, MTEs will be overestimated by more than 20% in values.

preprint2022arXiv

Towards Fast Theta-join: A Prefiltering and Amalgamated Partitioning Approach

As one of the most useful online processing techniques, the theta-join operation has been utilized by many applications to fully excavate the relationships between data streams in various scenarios. As such, constant research efforts have been put to optimize its performance in the distributed environment, which is typically characterized by reducing the number of Cartesian products as much as possible. In this article, we design and implement a novel fast theta-join algorithm, called Prefap, by developing two distinct techniques - prefiltering and amalgamated partitioning-based on the state-of-the-art FastThetaJoin algorithm to optimize the efficiency of the theta-join operation. Firstly, we develop a prefiltering strategy before data streams are partitioned to reduce the amount of data to be involved and benefit a more fine-grained partitioning. Secondly, to avoid the data streams being partitioned in a coarse-grained isolated manner and improve the quality of the partition-level filtering, we introduce an amalgamated partitioning mechanism that can amalgamate the partitioning boundaries of two data streams to assist a fine-grained partitioning. With the integration of these two techniques into the existing FastThetaJoin algorithm, we design and implement a new framework to achieve a decreased number of Cartesian products and a higher theta-join efficiency. By comparing with existing algorithms, FastThetaJoin in particular, we evaluate the performance of Prefap on both synthetic and real data streams from two-way to multiway theta-join to demonstrate its superiority.

preprint2022arXiv

Towards Learning in Grey Spatiotemporal Systems: A Prophet to Non-consecutive Spatiotemporal Dynamics

Spatiotemporal forecasting is an imperative topic in data science due to its diverse and critical applications in smart cities. Existing works mostly perform consecutive predictions of following steps with observations completely and continuously obtained, where nearest observations can be exploited as key knowledge for instantaneous status estimation. However, the practical issues of early activity planning and sensor failures elicit a brand-new task, i.e., non-consecutive forecasting. In this paper, we define spatiotemporal learning systems with missing observation as Grey Spatiotemporal Systems (G2S) and propose a Factor-Decoupled learning framework for G2S (FDG2S), where the core idea is to hierarchically decouple multi-level factors and enable both flexible aggregations and disentangled uncertainty estimations. Firstly, to compensate for missing observations, a generic semantic-neighboring sequence sampling is devised, which selects representative sequences to capture both periodical regularity and instantaneous variations. Secondly, we turn the predictions of non-consecutive statuses into inferring statuses under expected combined exogenous factors. In particular, a factor-decoupled aggregation scheme is proposed to decouple factor-induced predictive intensity and region-wise proximity by two energy functions of conditional random field. To infer region-wise proximity under flexible factor-wise combinations and enable dynamic neighborhood aggregations, we further disentangle compounded influences of exogenous factors on region-wise proximity and learn to aggregate them. Given the inherent incompleteness and critical applications of G2S, a DisEntangled Uncertainty Quantification is put forward, to identify two types of uncertainty for reliability guarantees and model interpretations.

preprint2022arXiv

Trajectory Tracking Control of the Bionic Joint Actuated by Pneumatic Artificial Muscle Based on Robust Modeling

To simply and effectively realize the trajectory tracking control of a bionic joint actuated by a single pneumatic artificial muscle (PAM), a cascaded control strategy is proposed based on the robust modeling method. Firstly, the relationship between the input voltage of the proportional directional control valve and the inner driving pressure of PAM is expressed as a nonlinear model analytically. Secondly, the nonlinear relationship between the driving pressure input of PAM and the angular position output of the bionic joint is described as a second-order linear time-invariant model (LTI) accompanied by parametric perturbations, equivalently, and then the parameters of the model are identified by the robust modeling method. Then, a hybrid model is established based on the two models (the nonlinear model and the LTI model) and corresponding to it, a cascaded controller is developed, the outer loop of which is an H-infinite controller for the angular position tracking designed by loop-shaping design procedure (LSDP) and the inner loop is a nonlinear controller based on the feedback linearization theory for the PAM driving pressure control. Finally, the experiment is accomplished within the joint rotation range of 90 degrees and with the working frequency upper bound of 1.25 rad/s. And the joint with the developed cascaded controller tracks given reference trajectories with steady-state errors smaller than 2%. Results show that the trajectory tracking control of a highly nonlinear system is highly efficient using the proposed strategy in the case of relatively low work frequency.

preprint2022arXiv

VSEGAN: Visual Speech Enhancement Generative Adversarial Network

Speech enhancement is an essential task of improving speech quality in noise scenario. Several state-of-the-art approaches have introduced visual information for speech enhancement,since the visual aspect of speech is essentially unaffected by acoustic environment. This paper proposes a novel frameworkthat involves visual information for speech enhancement, by in-corporating a Generative Adversarial Network (GAN). In par-ticular, the proposed visual speech enhancement GAN consistof two networks trained in adversarial manner, i) a generator that adopts multi-layer feature fusion convolution network to enhance input noisy speech, and ii) a discriminator that attemptsto minimize the discrepancy between the distributions of the clean speech signal and enhanced speech signal. Experiment re-sults demonstrated superior performance of the proposed modelagainst several state-of-the-art

preprint2022arXiv

Wasserstein Graph Neural Networks for Graphs with Missing Attributes

Missing node attributes is a common problem in real-world graphs. Graph neural networks have been demonstrated power in graph representation learning while their performance is affected by the completeness of graph information. Most of them are not specified for missing-attribute graphs and fail to leverage incomplete attribute information effectively. In this paper, we propose an innovative node representation learning framework, Wasserstein Graph Neural Network (WGNN), to mitigate the problem. To make the most of limited observed attribute information and capture the uncertainty caused by missing values, we express nodes as low-dimensional distributions derived from the decomposition of the attribute matrix. Furthermore, we strengthen the expressiveness of representations by developing a novel message passing schema that aggregates distributional information from neighbors in the Wasserstein space. We test WGNN in node classification tasks under two missing-attribute cases on both synthetic and real-world datasets. In addition, we find WGNN suitable to recover missing values and adapt them to tackle matrix completion problems with graphs of users and items. Experimental results on both tasks demonstrate the superiority of our method.

preprint2022arXiv

When Does A Spectral Graph Neural Network Fail in Node Classification?

Spectral Graph Neural Networks (GNNs) with various graph filters have received extensive affirmation due to their promising performance in graph learning problems. However, it is known that GNNs do not always perform well. Although graph filters provide theoretical foundations for model explanations, it is unclear when a spectral GNN will fail. In this paper, focusing on node classification problems, we conduct a theoretical analysis of spectral GNNs performance by investigating their prediction error. With the aid of graph indicators including homophily degree and response efficiency we proposed, we establish a comprehensive understanding of complex relationships between graph structure, node labels, and graph filters. We indicate that graph filters with low response efficiency on label difference are prone to fail. To enhance GNNs performance, we provide a provably better strategy for filter design from our theoretical analysis - using data-driven filter banks, and propose simple models for empirical validation. Experimental results show consistency with our theoretical results and support our strategy.

preprint2021arXiv

A strange metal in a bosonic system

Fermi liquid theory forms the basis for our understanding of the majority of metals, which is manifested in the description of transport properties that the electrical resistivity goes as temperature squared in the limit of zero temperature. However, the observations of strange metal states in various quantum materials, notably high-temperature superconductors, bring this spectacularly successful theoretical framework into crisis. When electron scattering rate 1/τ hits its limit, kBT/{\hbar} where {\hbar} is the reduced Planck's constant, T represents absolute temperature and kB denotes Boltzmann's constant, Planckian dissipation occurs and lends strange metals a surprising link to black holes, gravity, and quantum information theory. Here, we show the characteristic signature of strange metallicity arising unprecedentedly in a bosonic system. Our nanopatterned YBa2Cu3O7-δ(YBCO) film arrays reveal T-linear resistance as well as B-linear magnetoresistance over an extended temperature and magnetic field range in a quantum critical region in the phase diagram. Moreover, the slope of the T-linear resistance α_cp appears bounded by α_cp {\approx} h/2e^2 [1/T]_c^onset where T_c^onset is the temperature at which Cooper pairs form, intimating a common scale-invariant transport mechanism corresponding to Planckian dissipation.In contrast to fermionic systems where the temperature and magnetic field dependent scattering rates combine in quadrature of {\hbar}/τ {\approx} {\sqrt} (((k_B T)^2+(μ_B B)^2)), both terms linearly combine in the present bosonic system, i.e. {\hbar}/τ {\approx} (k_B T+[γμ]_B B), where γ is a constant. By extending the reach of strange metal phenomenology to a bosonic system, our results suggest that there is a fundamental principle governing their transport which transcends particle statistics.

preprint2021arXiv

AdaCrowd: Unlabeled Scene Adaptation for Crowd Counting

We address the problem of image-based crowd counting. In particular, we propose a new problem called unlabeled scene-adaptive crowd counting. Given a new target scene, we would like to have a crowd counting model specifically adapted to this particular scene based on the target data that capture some information about the new scene. In this paper, we propose to use one or more unlabeled images from the target scene to perform the adaptation. In comparison with the existing problem setups (e.g. fully supervised), our proposed problem setup is closer to the real-world applications of crowd counting systems. We introduce a novel AdaCrowd framework to solve this problem. Our framework consists of a crowd counting network and a guiding network. The guiding network predicts some parameters in the crowd counting network based on the unlabeled images from a particular scene. This allows our model to adapt to different target scenes. The experimental results on several challenging benchmark datasets demonstrate the effectiveness of our proposed approach compared with other alternative methods. Code is available at https://github.com/maheshkkumar/adacrowd.

preprint2021arXiv

Dense Residual Network: Enhancing Global Dense Feature Flow for Character Recognition

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Networks (DenseNet), have achieved great success for image representation by discovering deep hierarchical information. However, most existing networks simply stacks the convolutional layers and hence failing to fully discover local and global feature information among layers. In this paper, we mainly explore how to enhance the local and global dense feature flow by exploiting hierarchical features fully from all the convolution layers. Technically, we propose an efficient and effective CNN framework, i.e., Fast Dense Residual Network (FDRN), for text recognition. To construct FDRN, we propose a new fast residual dense block (f-RDB) to retain the ability of local feature fusion and local residual learning of original RDB, which can reduce the computing efforts at the same time. After fully learning local residual dense features, we utilize the sum operation and several f-RDBs to define a new block termed global dense block (GDB) by imitating the construction of dense blocks to learn global dense residual features adaptively in a holistic way. Finally, we use two convolution layers to construct a down-sampling block to reduce the global feature size and extract deeper features. Extensive simulations show that FDRN obtains the enhanced recognition results, compared with other related models.

preprint2021arXiv

Inferring galaxy dark halo properties from visible matter with Machine Learning

Next-generation surveys will provide photometric and spectroscopic data of millions to billions of galaxies with unprecedented precision. This offers a unique chance to improve our understanding of the galaxy evolution and the unresolved nature of dark matter (DM). At galaxy scales, the density distribution of DM is strongly affected by the astrophysical feedback processes, which are difficult to fully account for in classical techniques to derive mass models. In this work, we explore the capability of supervised learning algorithms to predict the DM content of galaxies from luminous observational-like parameters, using the public catalog of the TNG100 simulation. In particular, we use Photometric, Structural and Kinematic parameters to predict the total DM mass, DM half-mass radius, DM mass inside one and two stellar half-mass radii. We adopt the coefficient of determination, $R^2$, as a reference metric to evaluate the accuracy of these predictions. We find that the Photometric features alone are able to predict the total DM mass with fair accuracy, while Structural and Photometric features together are more effective to determine the DM inside the stellar half mass radius, and the DM within twice the stellar half mass radius. However, using all observational quantities together (Photometry, Structural and Kinematics) incredibly improves the overall accuracy for all DM quantities. This first test shows that Machine Learning tools are promising approaches to derive predictions of the DM in real galaxies. The next steps will be to improve observational realism of the training sets, by closely select samples which accurately reproduce the typical observed luminous scaling relations. The trained pipelines will be suitable for real galaxy data collected from the next-generation surveys like Rubin/LSST, Euclid, CSST, 4MOST, DESI, to derive, e.g., the properties of their central DM fractions.

preprint2021arXiv

Mutant reduction evaluation: what is there and what is missing?

Background. Many mutation reduction strategies, which aim to reduce the number of mutants, have been proposed. Problem. It is important to measure the ability of a mutation reduction strategy to maintain test suite effectiveness evaluation. However, existing evaluation indicators are unable to measure the "order-preserving ability". Objective. We aim to propose evaluation indicators to measure the "order-preserving ability" of a mutation reduction strategy, which is important but missing in our community. Method. Given a test suite on a Software Under Test (SUT) with a set of original mutants, we leverage the test suite to generate a group of test suites that have a partial order relationship in fault detecting potential. When evaluating a reduction strategy, we first construct two partial order relationships among the generated test suites in terms of mutation score, one with the original mutants and another with the reduced mutants. Then, we measure the extent to which the two partial order relationships are consistent. The more consistent the two partial order relationships are, the stronger the Order Preservation (OP) of the mutation reduction strategy is, and the more effective the reduction strategy is. Furthermore, we propose Effort-aware Relative Order Preservation (EROP) to measure how much gain a mutation reduction strategy can provide compared with a random reduction strategy. Result. The experimental results show that OP and EROP are able to efficiently measure the "order-preserving ability" of a mutation reduction strategy. As a result, they have a better ability to distinguish various mutation reduction strategies compared with the existing evaluation indicators. Conclusion. We suggest, for the researchers, that OP and EROP should be used to measure the effectiveness of a mutant reduction strategy.

preprint2021arXiv

NBSearch: Semantic Search and Visual Exploration of Computational Notebooks

Code search is an important and frequent activity for developers using computational notebooks (e.g., Jupyter). The flexibility of notebooks brings challenges for effective code search, where classic search interfaces for traditional software code may be limited. In this paper, we propose, NBSearch, a novel system that supports semantic code search in notebook collections and interactive visual exploration of search results. NBSearch leverages advanced machine learning models to enable natural language search queries and intuitive visualizations to present complicated intra- and inter-notebook relationships in the returned results. We developed NBSearch through an iterative participatory design process with two experts from a large software company. We evaluated the models with a series of experiments and the whole system with a controlled user study. The results indicate the feasibility of our analytical pipeline and the effectiveness of NBSearch to support code search in large notebook collections.

preprint2021arXiv

Overlapping Domain Decomposition Methods for Ptychographic Imaging

In ptychography experiments, redundant scanning is usually required to guarantee the stable recovery, such that a huge amount of frames are generated, and thus it poses a great demand of parallel computing in order to solve this large-scale inverse problem. In this paper, we propose the overlapping Domain Decomposition Methods(DDMs) to solve the nonconvex optimization problem in ptychographic imaging. They decouple the problem defined on the whole domain into subproblems only defined on the subdomains with synchronizing information in the overlapping regions of these subdomains,thus leading to highly parallel algorithms with good load balance. More specifically, for the nonblind recovery (with known probe in advance), by enforcing the continuity of the overlapping regions for the image (sample), the nonlinear optimization model is established based on a novel smooth-truncated amplitude-Gaussian metric (ST-AGM). Such metric allows for fast calculation of the proximal mapping with closed form, and meanwhile provides the possibility for the convergence guarantee of the first-order nonconvex optimization algorithm due to its Lipschitz smoothness. Then the Alternating Direction Method of Multipliers (ADMM) is utilized to generate an efficient Overlapping Domain Decomposition based Ptychography algorithm(OD2P) for the two-subdomain domain decomposition (DD), where all subproblems can be computed with close-form solutions.Due to the Lipschitz continuity for the gradient of the objective function with ST-AGM, the convergence of the proposed OD2P is derived under mild conditions. Moreover, it is extended to more general case including multiple-subdomain DD and blind recovery. Numerical experiments are further conducted to show the performance of proposed algorithms, demonstrating good convergence speed and robustness to the noise.

preprint2021arXiv

Panel: Humans and Technology for Inclusive Privacy and Security

Computer security and user privacy are critical issues and concerns in the digital era due to both increasing users and threats to their data. Separate issues arise between generic cybersecurity guidance (i.e., protect all user data from malicious threats) and the individualistic approach of privacy (i.e., specific to users and dependent on user needs and risk perceptions). Research has shown that several security- and privacy-focused vulnerabilities are technological (e.g., software bugs (Streiff, Kenny, Das, Leeth, & Camp, 2018), insecure authentication (Das, Wang, Tingle, & Camp, 2019)), or behavioral (e.g., sharing passwords (Das, Dingman, & Camp, 2018); and compliance (Das, Dev, & Srinivasan, 2018) (Dev, Das, Rashidi, & Camp, 2019)). This panel proposal addresses a third category of sociotechnical vulnerabilities that can and sometimes do arise from non-inclusive design of security and privacy. In this panel, we will address users' needs and desires for privacy. The panel will engage in in-depth discussions about value-sensitive design while focusing on potentially vulnerable populations, such as older adults, teens, persons with disabilities, and others who are not typically emphasized in general security and privacy concerns. Human factors have a stake in and ability to facilitate improvements in these areas.

preprint2021arXiv

Provable Near-Optimal Low-Multilinear-Rank Tensor Recovery

We consider the problem of recovering a low-multilinear-rank tensor from a small amount of linear measurements. We show that the Riemannian gradient algorithm initialized by one step of iterative hard thresholding can reconstruct an order-$d$ tensor of size $n\times\ldots\times n$ and multilinear rank $(r,\ldots,r)$ with high probability from only $O(nr^2 + r^{d+1})$ measurements, assuming $d$ is a constant. This sampling complexity is optimal in $n$, compared to existing results whose sampling complexities are all unnecessarily large in $n$. The analysis relies on the tensor restricted isometry property (TRIP) and the geometry of the manifold of all tensors with a fixed multilinear rank. High computational efficiency of our algorithm is also achieved by doing higher order singular value decomposition on intermediate small tensors of size only $2r\times \ldots\times 2r$ rather than on tensors of size $n\times \ldots\times n$ as usual.

preprint2021arXiv

Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network

We consider the problem of referring segmentation in images and videos with natural language. Given an input image (or video) and a referring expression, the goal is to segment the entity referred by the expression in the image or video. In this paper, we propose a cross-modal self-attention (CMSA) module to utilize fine details of individual words and the input image or video, which effectively captures the long-range dependencies between linguistic and visual features. Our model can adaptively focus on informative words in the referring expression and important regions in the visual input. We further propose a gated multi-level fusion (GMLF) module to selectively integrate self-attentive cross-modal features corresponding to different levels of visual features. This module controls the feature fusion of information flow of features at different levels with high-level and low-level semantic information related to different attentive words. Besides, we introduce cross-frame self-attention (CFSA) module to effectively integrate temporal information in consecutive frames which extends our method in the case of referring segmentation in videos. Experiments on benchmark datasets of four referring image datasets and two actor and action video segmentation datasets consistently demonstrate that our proposed approach outperforms existing state-of-the-art methods.

preprint2021arXiv

Solving phase retrieval with random initial guess is nearly as good as by spectral initialization

The problem of recovering a signal $\mathbf{x}\in \mathbb{R}^n$ from a set of magnitude measurements $y_i=|\langle \mathbf{a}_i, \mathbf{x} \rangle |, \; i=1,\ldots,m$ is referred as phase retrieval, which has many applications in fields of physical sciences and engineering. In this paper we show that the smoothed amplitude flow model for phase retrieval has benign geometric structure under the optimal sampling complexity. In particular, we show that when the measurements $\mathbf{a}_i\in \mathbb{R}^n$ are Gaussian random vectors and the number of measurements $m\ge Cn$, our smoothed amplitude flow model has no spurious local minimizers with high probability, ie., the target solution $\mathbf{x}$ is the unique global minimizer (up to a global phase) and the loss function has a negative directional curvature around each saddle point. Due to this benign geometric landscape, the phase retrieval problem can be solved by the gradient descent algorithms without spectral initialization. Numerical experiments show that the gradient descent algorithm with random initialization performs well even comparing with state-of-the-art algorithms with spectral initialization in empirical success rate and convergence speed.

preprint2021arXiv

Spectroscopic Evidence for a Three-Dimensional Charge Density Wave in Kagome Superconductor CsV$_3$Sb$_5$

The recently discovered AV3Sb5 (A=K, Rb, Cs) family, possessing V kagome nets, has received considerable attention due to the topological electronic structure and intriguing correlated phenomena, including an exotic charge density wave (CDW) and superconductivity. Detailed electronic structure studies are essential to unravel the characteristics and origin of the CDW as well as its interplay with superconductivity. Here, we present angle-resolved photoemission spectroscopy (ARPES) measurements for CsV3Sb5 at multiple temperatures and photon energies to reveal the nature of the CDW from an electronic structure perspective. We present evidence for a three-dimensional (3D) CDW order. In the process we also pinpoint a surface state attributed to a Cs terminated surface. This state was previously attributed to band folding band due to a CDW along the c direction or a quantum well state from quantum confinement. The CDW expected 2-fold lattice reconstruction along c axis is observed to be a quadrupling of the unit cell, thus for the first time directly demonstrating the 3D nature of the CDW from the electronic structure perspective. Moreover, this 3D CDW configuration originates from two distinct types of distortions in adjacent kagome layers. These present results not only provide key insights into the nature of the unconventional CDW in CsV3Sb5 but also provides an important reference for further studies on the relationship between the CDW and superconductivity.

preprint2021arXiv

Spectroscopic Evidence on Realization of a Genuine Topological Nodal Line Semimetal in LaSbTe

The nodal line semimetals have attracted much attention due to their unique topological electronic structure and exotic physical properties. A genuine nodal line semimetal is qualified by the presence of Dirac nodes along a line in the momentum space that are protected against the spin-orbit coupling. In addition, it requires that the Dirac points lie close to the Fermi level allowing to dictate the macroscopic physical properties. Although the material realization of nodal line semimetals have been theoretically predicted in numerous compounds, only a few of them have been experimentally verified and the realization of a genuine nodal line semimetal is particularly rare. Here we report the realization of a genuine nodal line semimetal in LaSbTe. We investigated the electronic structure of LaSbTe by band structure calculations and angle-resolved photoemission (ARPES) measurements. Taking spin-orbit coupling into account, our band structure calculations predict that a nodal line is formed in the boundary surface of the Brillouin zone which is robust and lies close to the Fermi level. The Dirac nodes along the X-R line in momentum space are directly observed in our ARPES measurements and the energies of these Dirac nodes are all close to the Fermi level. These results constitute clear evidence that LaSbTe is a genuine nodal line semimetal,providing a new platform to explore for novel phenomena and possible applications associated with the nodal line semimetals.

preprint2021arXiv

STUaNet: Understanding uncertainty in spatiotemporal collective human mobility

The high dynamics and heterogeneous interactions in the complicated urban systems have raised the issue of uncertainty quantification in spatiotemporal human mobility, to support critical decision-makings in risk-aware web applications such as urban event prediction where fluctuations are of significant interests. Given the fact that uncertainty quantifies the potential variations around prediction results, traditional learning schemes always lack uncertainty labels, and conventional uncertainty quantification approaches mostly rely upon statistical estimations with Bayesian Neural Networks or ensemble methods. However, they have never involved any spatiotemporal evolution of uncertainties under various contexts, and also have kept suffering from the poor efficiency of statistical uncertainty estimation while training models with multiple times. To provide high-quality uncertainty quantification for spatiotemporal forecasting, we propose an uncertainty learning mechanism to simultaneously estimate internal data quality and quantify external uncertainty regarding various contextual interactions. To address the issue of lacking labels of uncertainty, we propose a hierarchical data turbulence scheme where we can actively inject controllable uncertainty for guidance, and hence provide insights to both uncertainty quantification and weak supervised learning. Finally, we re-calibrate and boost the prediction performance by devising a gated-based bridge to adaptively leverage the learned uncertainty into predictions. Extensive experiments on three real-world spatiotemporal mobility sets have corroborated the superiority of our proposed model in terms of both forecasting and uncertainty quantification.

preprint2021arXiv

Trajectory Design for UAV-Based Internet-of-Things Data Collection: A Deep Reinforcement Learning Approach

In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted Internet-of-Things (IoT) system in a sophisticated three-dimensional (3D) environment, where the UAV's trajectory is optimized to efficiently collect data from multiple IoT ground nodes. Unlike existing approaches focusing only on a simplified two-dimensional scenario and the availability of perfect channel state information (CSI), this paper considers a practical 3D urban environment with imperfect CSI, where the UAV's trajectory is designed to minimize data collection completion time subject to practical throughput and flight movement constraints. Specifically, inspired from the state-of-the-art deep reinforcement learning approaches, we leverage the twin-delayed deep deterministic policy gradient (TD3) to design the UAV's trajectory and present a TD3-based trajectory design for completion time minimization (TD3-TDCTM) algorithm. In particular, we set an additional information, i.e., the merged pheromone, to represent the state information of UAV and environment as a reference of reward which facilitates the algorithm design. By taking the service statuses of IoT nodes, the UAV's position, and the merged pheromone as input, the proposed algorithm can continuously and adaptively learn how to adjust the UAV's movement strategy. By interacting with the external environment in the corresponding Markov decision process, the proposed algorithm can achieve a near-optimal navigation strategy. Our simulation results show the superiority of the proposed TD3-TDCTM algorithm over three conventional non-learning based baseline methods.

preprint2021arXiv

Variational quantum process tomography

Quantum process tomography is an experimental technique to fully characterize an unknown quantum process. Standard quantum process tomography suffers from exponentially scaling of the number of measurements with the increasing system size. In this work, we put forward a quantum machine learning algorithm which approximately encodes the unknown unitary quantum process into a relatively shallow depth parametric quantum circuit. We demonstrate our method by reconstructing the unitary quantum processes resulting from the quantum Hamiltonian evolution and random quantum circuits up to $8$ qubits. Results show that those quantum processes could be reconstructed with high fidelity, while the number of input states required are at least $2$ orders of magnitude less than required by the standard quantum process tomography.

preprint2020arXiv

A Mathematical Introduction to Generative Adversarial Nets (GAN)

Generative Adversarial Nets (GAN) have received considerable attention since the 2014 groundbreaking work by Goodfellow et al. Such attention has led to an explosion in new ideas, techniques and applications of GANs. To better understand GANs we need to understand the mathematical foundation behind them. This paper attempts to provide an overview of GANs from a mathematical point of view. Many students in mathematics may find the papers on GANs more difficulty to fully understand because most of them are written from computer science and engineer point of view. The aim of this paper is to give more mathematically oriented students an introduction to GANs in a language that is more familiar to them.

preprint2020arXiv

Adaptive Video Highlight Detection by Learning from User History

Recently, there is an increasing interest in highlight detection research where the goal is to create a short duration video from a longer video by extracting its interesting moments. However, most existing methods ignore the fact that the definition of video highlight is highly subjective. Different users may have different preferences of highlight for the same input video. In this paper, we propose a simple yet effective framework that learns to adapt highlight detection to a user by exploiting the user's history in the form of highlights that the user has previously created. Our framework consists of two sub-networks: a fully temporal convolutional highlight detection network $H$ that predicts highlight for an input video and a history encoder network $M$ for user history. We introduce a newly designed temporal-adaptive instance normalization (T-AIN) layer to $H$ where the two sub-networks interact with each other. T-AIN has affine parameters that are predicted from $M$ based on the user history and is responsible for the user-adaptive signal to $H$. Extensive experiments on a large-scale dataset show that our framework can make more accurate and user-specific highlight predictions.

preprint2020arXiv

An averaged cluster approach to including chemical short range order in KKR-CPA

The single-site Korringa-Kohn-Rostoker Coherent Potential Approximation (KKR-CPA) ignores short range ordering present in disordered metallic systems. In this paper, we establish a new technique to fix this shortcoming by embedding an averaged cluster that displays chemical short range order (SRO). The degree of SRO can be tuned by externally defined order parameters. This averaged cluster can be embedded in the single site CPA medium, or a self-consistently obtained effective medium that contains SRO information. The validity of this method is demonstrated by applying it to two alloy systems - the CuZn body centered cubic (BCC) solid solution, and AlCrTiV, a four-element BCC high entropy alloy. A comparison between the non-self-consistent and self-consistent modes is also provided for the two above mentioned systems. We make the code available on the internet. Planned extensions to this work are discussed.

preprint2020arXiv

Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to-End Deep Learning

The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the effort of doctors is of great value. At present, the applications of artificial intelligence in CXR diagnosis usually use pattern recognition to classify the scans. However, such methods rely on labeled databases, which are costly and usually have large error rates. In this work, we built a database containing more than 12,000 CXR scans and radiological reports, and developed a model based on deep convolutional neural network and recurrent network with attention mechanism. The model learns features from the CXR scans and the associated raw radiological reports directly; no additional labeling of the scans are needed. The model provides automated recognition of given scans and generation of reports. The quality of the generated reports was evaluated with both the CIDEr scores and by radiologists as well. The CIDEr scores are found to be around 5.8 on average for the testing dataset. Further blind evaluation suggested a comparable performance against human radiologist.

preprint2020arXiv

Compressed DenseNet for Lightweight Character Recognition

Convolutional Recurrent Neural Network (CRNN) is a popular network for recognizing texts in images. Advances like the variant of CRNN, such as Dense Convolutional Network with Connectionist Temporal Classification, has reduced the running time of the network, but exposing the inner computation cost and weight size of the convolutional networks as a bottleneck. Specifically, the DenseNet based models utilize the dense blocks as the core module, but the inner features are combined in the form of concatenation in dense blocks. As such, the number of channels of combined features delivered as the input of the layers close to the output and the relevant computational cost grows rapidly with the dense blocks getting deeper. This will severely bring heavy computational cost and big weight size, which restrict the depth of dense blocks. In this paper, we propose a compressed convolution block called Lightweight Dense Block (LDB). To reduce the computing cost and weight size, we re-define and re-design the way of combining internal features of the dense blocks. LDB is a convolutional block similarly as dense block, but it can reduce the computation cost and weight size to (1/L, 2/L), compared with original ones, where L is the number of layers in blocks. Moreover, LDB can be used to replace the original dense block in any DenseNet based models. Based on the LDBs, we propose a Compressed DenseNet (CDenseNet) for the lightweight character recognition. Extensive experiments demonstrate that CDenseNet can effectively reduce the weight size while delivering the promising recognition results.

preprint2020arXiv

Convex Shape Representation with Binary Labels for Image Segmentation: Models and Fast Algorithms

We present a novel and effective binary representation for convex shapes. We show the equivalence between the shape convexity and some properties of the associated indicator function. The proposed method has two advantages. Firstly, the representation is based on a simple inequality constraint on the binary function rather than the definition of convex shapes, which allows us to obtain efficient algorithms for various applications with convexity prior. Secondly, this method is independent of the dimension of the concerned shape. In order to show the effectiveness of the proposed representation approach, we incorporate it with a probability based model for object segmentation with convexity prior. Efficient algorithms are given to solve the proposed models using Lagrange multiplier methods and linear approximations. Various experiments are given to show the superiority of the proposed methods.

preprint2020arXiv

Convolutional Dictionary Pair Learning Network for Image Representation Learning

Both the Dictionary Learning (DL) and Convolutional Neural Networks (CNN) are powerful image representation learning systems based on different mechanisms and principles, however whether we can seamlessly integrate them to improve the per-formance is noteworthy exploring. To address this issue, we propose a novel generalized end-to-end representation learning architecture, dubbed Convolutional Dictionary Pair Learning Network (CDPL-Net) in this paper, which integrates the learning schemes of the CNN and dictionary pair learning into a unified framework. Generally, the architecture of CDPL-Net includes two convolutional/pooling layers and two dictionary pair learn-ing (DPL) layers in the representation learning module. Besides, it uses two fully-connected layers as the multi-layer perception layer in the nonlinear classification module. In particular, the DPL layer can jointly formulate the discriminative synthesis and analysis representations driven by minimizing the batch based reconstruction error over the flatted feature maps from the convolution/pooling layer. Moreover, DPL layer uses l1-norm on the analysis dictionary so that sparse representation can be delivered, and the embedding process will also be robust to noise. To speed up the training process of DPL layer, the efficient stochastic gradient descent is used. Extensive simulations on real databases show that our CDPL-Net can deliver enhanced performance over other state-of-the-art methods.

preprint2020arXiv

Cross-Modal Weighting Network for RGB-D Salient Object Detection

Depth maps contain geometric clues for assisting Salient Object Detection (SOD). In this paper, we propose a novel Cross-Modal Weighting (CMW) strategy to encourage comprehensive interactions between RGB and depth channels for RGB-D SOD. Specifically, three RGB-depth interaction modules, named CMW-L, CMW-M and CMW-H, are developed to deal with respectively low-, middle- and high-level cross-modal information fusion. These modules use Depth-to-RGB Weighing (DW) and RGB-to-RGB Weighting (RW) to allow rich cross-modal and cross-scale interactions among feature layers generated by different network blocks. To effectively train the proposed Cross-Modal Weighting Network (CMWNet), we design a composite loss function that summarizes the errors between intermediate predictions and ground truth over different scales. With all these novel components working together, CMWNet effectively fuses information from RGB and depth channels, and meanwhile explores object localization and details across scales. Thorough evaluations demonstrate CMWNet consistently outperforms 15 state-of-the-art RGB-D SOD methods on seven popular benchmarks.

preprint2020arXiv

Deep Learning-based Image Compression with Trellis Coded Quantization

Recently many works attempt to develop image compression models based on deep learning architectures, where the uniform scalar quantizer (SQ) is commonly applied to the feature maps between the encoder and decoder. In this paper, we propose to incorporate trellis coded quantizer (TCQ) into a deep learning based image compression framework. A soft-to-hard strategy is applied to allow for back propagation during training. We develop a simple image compression model that consists of three subnetworks (encoder, decoder and entropy estimation), and optimize all of the components in an end-to-end manner. We experiment on two high resolution image datasets and both show that our model can achieve superior performance at low bit rates. We also show the comparisons between TCQ and SQ based on our proposed baseline model and demonstrate the advantage of TCQ.

preprint2020arXiv

Direct Measurement of the Electronic Structure and band gap nature of atomic-layer-thick 2H-MoTe2

The millimeter sized monolayer and bilayer 2H-MoTe2 single crystal samples are prepared by a new mechanical exfoliation method. Based on such high-quality samples, we report the first direct electronic structure study on them, using standard high resolution angle-resolved photoemission spectroscopy (ARPES). A direct band gap of 0.924eV is found at K in the rubidium-doped monolayer MoTe2. Similar valence band alignment is also observed in bilayer MoTe2,supporting an assumption of a analogous direct gap semiconductor on it. Our measurements indicate a rather large band splitting of 212meV at the valence band maximum (VBM) in monolayer MoTe2, and the splitting is systematically enlarged with layer stacking, from monolayer to bilayer and to bulk. Meanwhile, our PBE band calculation on these materials show excellent agreement with ARPES results. Some fundamental electronic parameters are derived from the experimental and calculated electronic structures. Our findings lay a foundation for further application-related study on monolayer and bilayer MoTe2.

preprint2020arXiv

Direct visualization of ambipolar Mott transition in cuprate CuO2 planes

Identifying the essence of doped Mott insulators is one of the major outstanding problems in condensed matter physics and the key to understanding the high-temperature superconductivity in cuprates. We report real space visualization of Mott transition in Sr1-xLaxCuO2+y cuprate films that cover the entire electron- and hole-doped regimes. Tunneling conductance measurements directly on the cooper-oxide (CuO2) planes reveal a systematic shift in the Fermi level, while the fundamental Mott-Hubbard band structure remains unchanged. This is further demonstrated by exploring atomic-scale electronic response of CuO2 to substitutional dopants and intrinsic defects in a sister compound Sr0.92Nd0.08CuO2. The results could be better explained in the framework of self-modulation doping, similar to that in semiconductor heterostructures, and form a basis for developing any microscopic theories for cuprate superconductivity.

preprint2020arXiv

Dual Convolutional LSTM Network for Referring Image Segmentation

We consider referring image segmentation. It is a problem at the intersection of computer vision and natural language understanding. Given an input image and a referring expression in the form of a natural language sentence, the goal is to segment the object of interest in the image referred by the linguistic query. To this end, we propose a dual convolutional LSTM (ConvLSTM) network to tackle this problem. Our model consists of an encoder network and a decoder network, where ConvLSTM is used in both encoder and decoder networks to capture spatial and sequential information. The encoder network extracts visual and linguistic features for each word in the expression sentence, and adopts an attention mechanism to focus on words that are more informative in the multimodal interaction. The decoder network integrates the features generated by the encoder network at multiple levels as its input and produces the final precise segmentation mask. Experimental results on four challenging datasets demonstrate that the proposed network achieves superior segmentation performance compared with other state-of-the-art methods.

preprint2020arXiv

Estimation of the Galaxy Quenching Rate in the Illustris Simulation

Quenching is a key topic in exploring the formation and evolution of galaxies. In this work, we study the quenching rate, i.e., the variation in the fraction of quenched galaxies per unit time, of the Illustris-1 simulation. By building the quenched fraction function $f(m,ρ, t)$ of each snapshot in the simulation, we derive an accurate form of quenching rate as $\Re_q=df(m,ρ,t)/dt$. According to the analytic expression of the quenching rate $\Re_q$, we split it into four components: mass quenching, environmental quenching, intrinsic mass quenching and intrinsic environmental quenching. The precise value and evolutions can be given via the formula of $\Re_q$. With this method, we analyze the Illustris-1 simulation. We find that quenched galaxies concentrate around $M_*\simeq10^{11}h^{-1}M_\odot$ and $δ+1\simeq10^{3.5}$ at earlier times, and that the quenching galaxy population slowly shifts to lower stellar mass and lower overdensity regions with time. We also find that mass quenching dominates the quenching process in this simulation, in agreement with some previous analytical models. Intrinsic quenching is the second most important component. Environmental quenching is very weak, because it is possible that the pre- or postprocessing of environments disguises environmental quenching as intrinsic quenching. We find that our method roughly predict the actual quenching rate. It could well predict the actual amount of galaxies quenched by intrinsic quenching. However, it overestimates the amount of mass quenching galaxies and underestimates the amount of environmental quenching. We suggest that the reason is the nonlinearity of the environmental overdensity change and mass growth of the galaxy.

preprint2020arXiv

Few-Shot Scene Adaptive Crowd Counting Using Meta-Learning

We consider the problem of few-shot scene adaptive crowd counting. Given a target camera scene, our goal is to adapt a model to this specific scene with only a few labeled images of that scene. The solution to this problem has potential applications in numerous real-world scenarios, where we ideally like to deploy a crowd counting model specially adapted to a target camera. We accomplish this challenge by taking inspiration from the recently introduced learning-to-learn paradigm in the context of few-shot regime. In training, our method learns the model parameters in a way that facilitates the fast adaptation to the target scene. At test time, given a target scene with a small number of labeled data, our method quickly adapts to that scene with a few gradient updates to the learned parameters. Our extensive experimental results show that the proposed approach outperforms other alternatives in few-shot scene adaptive crowd counting. Code is available at https://github.com/maheshkkumar/fscc.

preprint2020arXiv

Few-shot Scene-adaptive Anomaly Detection

We address the problem of anomaly detection in videos. The goal is to identify unusual behaviours automatically by learning exclusively from normal videos. Most existing approaches are usually data-hungry and have limited generalization abilities. They usually need to be trained on a large number of videos from a target scene to achieve good results in that scene. In this paper, we propose a novel few-shot scene-adaptive anomaly detection problem to address the limitations of previous approaches. Our goal is to learn to detect anomalies in a previously unseen scene with only a few frames. A reliable solution for this new problem will have huge potential in real-world applications since it is expensive to collect a massive amount of data for each target scene. We propose a meta-learning based approach for solving this new problem; extensive experimental results demonstrate the effectiveness of our proposed method.

preprint2020arXiv

Fully-Convolutional Intensive Feature Flow Neural Network for Text Recognition

The Deep Convolutional Neural Networks (CNNs) have obtained a great success for pattern recognition, such as recognizing the texts in images. But existing CNNs based frameworks still have several drawbacks: 1) the traditaional pooling operation may lose important feature information and is unlearnable; 2) the tradi-tional convolution operation optimizes slowly and the hierar-chical features from different layers are not fully utilized. In this work, we address these problems by developing a novel deep network model called Fully-Convolutional Intensive Feature Flow Neural Network (IntensiveNet). Specifically, we design a further dense block called intensive block to extract the feature information, where the original inputs and two dense blocks are connected tightly. To encode data appropriately, we present the concepts of dense fusion block and further dense fusion opera-tions for our new intensive block. By adding short connections to different layers, the feature flow and coupling between layers are enhanced. We also replace the traditional convolution by depthwise separable convolution to make the operation efficient. To prevent important feature information being lost to a certain extent, we use a convolution operation with stride 2 to replace the original pooling operation in the customary transition layers. The recognition results on large-scale Chinese string and MNIST datasets show that our IntensiveNet can deliver enhanced recog-nition results, compared with other related deep models.

preprint2020arXiv

Long distance measurement using single soliton microcomb

Dispersive interferometry (DPI) takes a major interest in optical frequency comb (OFC) based long distance laser-based light detection and ranging (LIDAR) for the merits of strong anti-interference ability and long coherent length. However, the mismatch between the repetition rate of OFC and the resolution of optical spectrum acquisition system induces a large dead-zone which is a major obstacle for practical applications. Here, a new DPI LIDAR on the strength of high-repetition-rate soliton microcomb is demonstrated, which reaches a minimum Allan deviation of 27 nm for an outdoor 1179 m ranging experiment. The proposed scheme approaches a compact, high-accuracy, and none-dead-zone long distance ranging system, opening up new opportunities for emerging applications of frontier scientific researches and advanced manufacturing.

preprint2020arXiv

Multilayer Collaborative Low-Rank Coding Network for Robust Deep Subspace Discovery

For subspace recovery, most existing low-rank representation (LRR) models performs in the original space in single-layer mode. As such, the deep hierarchical information cannot be learned, which may result in inaccurate recoveries for complex real data. In this paper, we explore the deep multi-subspace recovery problem by designing a multilayer architecture for latent LRR. Technically, we propose a new Multilayer Collabora-tive Low-Rank Representation Network model termed DeepLRR to discover deep features and deep subspaces. In each layer (>2), DeepLRR bilinearly reconstructs the data matrix by the collabo-rative representation with low-rank coefficients and projection matrices in the previous layer. The bilinear low-rank reconstruc-tion of previous layer is directly fed into the next layer as the input and low-rank dictionary for representation learning, and is further decomposed into a deep principal feature part, a deep salient feature part and a deep sparse error. As such, the coher-ence issue can be also resolved due to the low-rank dictionary, and the robustness against noise can also be enhanced in the feature subspace. To recover the sparse errors in layers accurately, a dynamic growing strategy is used, as the noise level will be-come smaller for the increase of layers. Besides, a neighborhood reconstruction error is also included to encode the locality of deep salient features by deep coefficients adaptively in each layer. Extensive results on public databases show that our DeepLRR outperforms other related models for subspace discovery and clustering.

preprint2020arXiv

Ontology-based annotation and analysis of COVID-19 phenotypes

The epidemic of COVID-19 has caused an unpredictable and devastated disaster to the public health in different territories around the world. Common phenotypes include fever, cough, shortness of breath, and chills. With more cases investigated, other clinical phenotypes are gradually recognized, for example, loss of smell, and loss of tastes. Compared with discharged or cured patients, severe or died patients often have one or more comorbidities, such as hypertension, diabetes, and cardiovascular disease. In this study, we systematically collected and analyzed COVID-19-related clinical phenotypes from 70 articles. The commonly occurring 17 phenotypes were classified into different groups based on the Human Phenotype Ontology (HPO). Based on the HP classification, we systematically analyze three nervous phenotypes (loss of smell, loss of taste, and headache) and four abdominal phenotypes (nausea, vomiting, abdominal pain, and diarrhea) identified in patients, and found that patients from Europe and USA turned to have higher nervous phenotypes and abdominal phenotypes than patients from Asia. A total of 23 comorbidities were found to commonly exist among COVID-19 patients. Patients with these comorbidities such as diabetes and kidney failure had worse outcomes compared with those without these comorbidities.

preprint2020arXiv

Ontology-based systematic classification and analysis of coronaviruses, hosts, and host-coronavirus interactions towards deep understanding of COVID-19

Given the existing COVID-19 pandemic worldwide, it is critical to systematically study the interactions between hosts and coronaviruses including SARS-Cov, MERS-Cov, and SARS-CoV-2 (cause of COVID-19). We first created four host-pathogen interaction (HPI)-Outcome postulates, and generated a HPI-Outcome model as the basis for understanding host-coronavirus interactions (HCI) and their relations with the disease outcomes. We hypothesized that ontology can be used as an integrative platform to classify and analyze HCI and disease outcomes. Accordingly, we annotated and categorized different coronaviruses, hosts, and phenotypes using ontologies and identified their relations. Various COVID-19 phenotypes are hypothesized to be caused by the backend HCI mechanisms. To further identify the causal HCI-outcome relations, we collected 35 experimentally-verified HCI protein-protein interactions (PPIs), and applied literature mining to identify additional host PPIs in response to coronavirus infections. The results were formulated in a logical ontology representation for integrative HCI-outcome understanding. Using known PPIs as baits, we also developed and applied a domain-inferred prediction method to predict new PPIs and identified their pathological targets on multiple organs. Overall, our proposed ontology-based integrative framework combined with computational predictions can be used to support fundamental understanding of the intricate interactions between human patients and coronaviruses (including SARS-CoV-2) and their association with various disease outcomes.

preprint2020arXiv

Optimal l-one Rank One Matrix Decompositions

In this paper we consider the decomposition of positive semidefinite matrices as a sum of rank one matrices. We introduce and investigate the properties of various measures of optimality of such decompositions. For some classes of positive semidefinite matrices we give explicitly these optimal decompositions. These classes include diagonally dominant matrices and certain of their generalizations, $2\times 2$, and a class of $3\times 3$ matrices.

preprint2020arXiv

Recovering Accurate Labeling Information from Partially Valid Data for Effective Multi-Label Learning

Partial Multi-label Learning (PML) aims to induce the multi-label predictor from datasets with noisy supervision, where each training instance is associated with several candidate labels but only partially valid. To address the noisy issue, the existing PML methods basically recover the ground-truth labels by leveraging the ground-truth confidence of the candidate label, \ie the likelihood of a candidate label being a ground-truth one. However, they neglect the information from non-candidate labels, which potentially contributes to the ground-truth label recovery. In this paper, we propose to recover the ground-truth labels, \ie estimating the ground-truth confidences, from the label enrichment, composed of the relevance degrees of candidate labels and irrelevance degrees of non-candidate labels. Upon this observation, we further develop a novel two-stage PML method, namely \emph{\underline{P}artial \underline{M}ulti-\underline{L}abel \underline{L}earning with \underline{L}abel \underline{E}nrichment-\underline{R}ecovery} (\baby), where in the first stage, it estimates the label enrichment with unconstrained label propagation, then jointly learns the ground-truth confidence and multi-label predictor given the label enrichment. Experimental results validate that \baby outperforms the state-of-the-art PML methods.

preprint2020arXiv

Recurrent Relational Memory Network for Unsupervised Image Captioning

Unsupervised image captioning with no annotations is an emerging challenge in computer vision, where the existing arts usually adopt GAN (Generative Adversarial Networks) models. In this paper, we propose a novel memory-based network rather than GAN, named Recurrent Relational Memory Network ($R^2M$). Unlike complicated and sensitive adversarial learning that non-ideally performs for long sentence generation, $R^2M$ implements a concepts-to-sentence memory translator through two-stage memory mechanisms: fusion and recurrent memories, correlating the relational reasoning between common visual concepts and the generated words for long periods. $R^2M$ encodes visual context through unsupervised training on images, while enabling the memory to learn from irrelevant textual corpus via supervised fashion. Our solution enjoys less learnable parameters and higher computational efficiency than GAN-based methods, which heavily bear parameter sensitivity. We experimentally validate the superiority of $R^2M$ than state-of-the-arts on all benchmark datasets.

preprint2020arXiv

RiskOracle: A Minute-level Citywide Traffic Accident Forecasting Framework

Real-time traffic accident forecasting is increasingly important for public safety and urban management (e.g., real-time safe route planning and emergency response deployment). Previous works on accident forecasting are often performed on hour levels, utilizing existed neural networks with static region-wise correlations taken into account. However, it is still challenging when the granularity of forecasting step improves as the highly dynamic nature of road network and inherent rareness of accident records in one training sample, which leads to biased results and zero-inflated issue. In this work, we propose a novel framework RiskOracle, to improve the prediction granularity to minute levels. Specifically, we first transform the zero-risk values in labels to fit the training network. Then, we propose the Differential Time-varying Graph neural network (DTGN) to capture the immediate changes of traffic status and dynamic inter-subregion correlations. Furthermore, we adopt multi-task and region selection schemes to highlight citywide most-likely accident subregions, bridging the gap between biased risk values and sporadic accident distribution. Extensive experiments on two real-world datasets demonstrate the effectiveness and scalability of our RiskOracle framework.

preprint2020arXiv

Satellite Alignment: III. Satellite Galaxies Spatial Distribution and their Dependence on Redshift with A Novel Galaxy Finder

After extensively explored, broad agreement between observations and theories has been reached that satellites are preferentially aligned with major axes of their host centrals. There are still some issues unsolved on this topic. In this paper, we present studies on satellite spatial distribution. To fairly compare with observations, we develop a novel galaxy finder and reconstruction algorithm in hydrodynamical simulation, which is based on the projected mock image, taking into account the full consideration of the point spread function, pixel size, surface brightness limit, resolution and redshift dimming effects. With galaxy samples constructed using such an algorithm, the satellite alignment is examined by comparing with observational results. It is found that the observational alignment can be reproduced for red galaxies, which dominate the sample in this study, but not for blue galaxies. Satellites' radial distribution is also investigated. It exhibits that outer satellites within host halos show stronger alignment signal than satellites in the inner regions, especially for red satellites, which is in contrast with previous studies. The disagreement is mainly due to extra galaxies identified by our new galaxy finder, which are mainly located in the inner region of host halos. Our study illustrates that at lower redshift, the alignment strength becomes stronger, while radial distribution curve becomes flatter. This suggests differences in the evolution of the angular distribution between satellites residing in the inner and outer halos, and implies that the post-infall evolution reduces the original alignment signal, that the impact decreases for satellites with later infall times.

preprint2020arXiv

Sentence Guided Temporal Modulation for Dynamic Video Thumbnail Generation

We consider the problem of sentence specified dynamic video thumbnail generation. Given an input video and a user query sentence, the goal is to generate a video thumbnail that not only provides the preview of the video content, but also semantically corresponds to the sentence. In this paper, we propose a sentence guided temporal modulation (SGTM) mechanism that utilizes the sentence embedding to modulate the normalized temporal activations of the video thumbnail generation network. Unlike the existing state-of-the-art method that uses recurrent architectures, we propose a non-recurrent framework that is simple and allows much more parallelization. Extensive experiments and analysis on a large-scale dataset demonstrate the effectiveness of our framework.

preprint2020arXiv

SimpleMKKM: Simple Multiple Kernel K-means

We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM). It extends the widely used supervised kernel alignment criterion to multi-kernel clustering. Our criterion is given by an intractable minimization-maximization problem in the kernel coefficient and clustering partition matrix. To optimize it, we re-formulate the problem as a smooth minimization one, which can be solved efficiently using a reduced gradient descent algorithm. We theoretically analyze the performance of SimpleMKKM in terms of its clustering generalization error. Comprehensive experiments on 11 benchmark datasets demonstrate that SimpleMKKM outperforms state of the art multi-kernel clustering alternatives.

preprint2020arXiv

Spectrum is rational in dimension one

A bounded measurable set $Ω\subset{\mathbb R}^d$ is called a spectral set if it admits some exponential orthonormal basis $\{e^{2πi \langleλ,x\rangle}: λ\inΛ\}$ for $L^2(Ω)$. In this paper, we show that in dimension one $d=1$, any spectrum $Λ$ with $0\inΛ$ of a spectral set $Ω$ with Lebesgue measure normalized to 1 must be rational. Combining previous results that spectrum must be periodic, the Fuglede's conjecture on ${\mathbb R}^1$ is now equivalent to the corresponding conjecture on all cyclic groups ${\mathbb Z}_{n}.$

preprint2020arXiv

Study of pseudogap and superconducting quasiparticle dynamics in $\rm{Bi_2Sr_2CaCu_2O_{8+δ}}$ by time-resolved optical reflectivity

The relation between pseudogap (PG) and superconducting (SC) gap, whether PG is a precursor of SC or they coexist or compete, is a long-standing controversy in cuprate high-temperature supercondutors. Here, we report ultrafast time-resolved optical reflectivity investigation of the dynamic densities and relaxations of PG and SC quasiparticles (QPs) in the underdoped $\rm{Bi_2Sr_2CaCu_2O_{8+δ}}$ ($T_c$ = 82 K) single crystals. We find evidence of two distinct PG components in the positive reflectivity changes in the PG state, characterized by relaxation timescales of $τ_{fast}$ $\approx$ 0.2 ps and $τ_{slow}$ $\approx$ 2 ps with abrupt changes in both amplitudes $A_{fast}$ and $A_{slow}$ at the PG-opening temperature $T^*$. The former presents no obvious change at $T_c$ and coexists with the SC QP. The latter's amplitude starts decreasing at the SC phase fluctuation $T_p$ and vanishes at $T_c$ followed by a negative amplitude signifying the emergence of the SC QP, therefore suggesting a competition with superconductivity.

preprint2020arXiv

Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusion

With the development of web technology, multi-modal or multi-view data has surged as a major stream for big data, where each modal/view encodes individual property of data objects. Often, different modalities are complementary to each other. Such fact motivated a lot of research attention on fusing the multi-modal feature spaces to comprehensively characterize the data objects. Most of the existing state-of-the-art focused on how to fuse the energy or information from multi-modal spaces to deliver a superior performance over their counterparts with single modal. Recently, deep neural networks have exhibited as a powerful architecture to well capture the nonlinear distribution of high-dimensional multimedia data, so naturally does for multi-modal data. Substantial empirical studies are carried out to demonstrate its advantages that are benefited from deep multi-modal methods, which can essentially deepen the fusion from multi-modal deep feature spaces. In this paper, we provide a substantial overview of the existing state-of-the-arts on the filed of multi-modal data analytics from shallow to deep spaces. Throughout this survey, we further indicate that the critical components for this field go to collaboration, adversarial competition and fusion over multi-modal spaces. Finally, we share our viewpoints regarding some future directions on this field.

preprint2020arXiv

Symmetry-Adapted Tight-Binding Electronic Structure Analysis of Carbon Nanotubes with Defects, Kinks, Twist, and Stretch

This paper applies a symmetry-adapted method to examine the influence of deformation and defects on the electronic structure and band structure in carbon nanotubes. First, the symmetry-adapted approach is used to develop the analog of Bloch waves. Building on this, the technique of perfectly-matched layers is applied to develop a method to truncate the computational domain of electronic structure calculations without spurious size effects. This provides an efficient and accurate numerical approach to compute the electronic structure and electromechanics of defects in nanotubes. The computational method is applied to study the effect of twist, stretch, and bending, with and without various types of defects, on the band structure of nanotubes. Specifically, the effect of stretch and twist on band structure in defect-free conducting and semiconducting nanotubes is examined, and the interaction with vacancy defects is elucidated. Next, the effect of localized bending or kinking on the electronic structure is studied. Finally, the paper examines the effect of 5-8-5 Stone-Wales defects. In all of these settings, the perfectly-matched layer method enables the calculation of localized non-propagating defect modes with energies in the bandgap of the defect-free nanotube.

preprint2020arXiv

Try This Instead: Personalized and Interpretable Substitute Recommendation

As a fundamental yet significant process in personalized recommendation, candidate generation and suggestion effectively help users spot the most suitable items for them. Consequently, identifying substitutable items that are interchangeable opens up new opportunities to refine the quality of generated candidates. When a user is browsing a specific type of product (e.g., a laptop) to buy, the accurate recommendation of substitutes (e.g., better equipped laptops) can offer the user more suitable options to choose from, thus substantially increasing the chance of a successful purchase. However, existing methods merely treat this problem as mining pairwise item relationships without the consideration of users' personal preferences. Moreover, the substitutable relationships are implicitly identified through the learned latent representations of items, leading to uninterpretable recommendation results. In this paper, we propose attribute-aware collaborative filtering (A2CF) to perform substitute recommendation by addressing issues from both personalization and interpretability perspectives. Instead of directly modelling user-item interactions, we extract explicit and polarized item attributes from user reviews with sentiment analysis, whereafter the representations of attributes, users, and items are simultaneously learned. Then, by treating attributes as the bridge between users and items, we can thoroughly model the user-item preferences (i.e., personalization) and item-item relationships (i.e., substitution) for recommendation. In addition, A2CF is capable of generating intuitive interpretations by analyzing which attributes a user currently cares the most and comparing the recommended substitutes with her/his currently browsed items at an attribute level. The recommendation effectiveness and interpretation quality of A2CF are demonstrated via extensive experiments on three real datasets.

preprint2020arXiv

Tunable capacitance in all-inkjet-printed nanosheet heterostructures

Heterostructures constructed from two-dimensional building blocks have shown promise for field-effect transistors, memory devices, photosensors and other electronic applications1,2. 2D nanosheet crystals can be constructed into multilayer heterostructures using layer-by-layer methods3, but that method cannot be used to fabricate large-scale and thick heterostructures, due to the time-consuming nature and low efficiency of the process. An alternative approach to deposit different two-dimensional materials is by inkjet printing4-7. Here we show the fabrication of a nanosheet supercapacitor by inkjet printing Ti3C2Tx MXene nanosheets as electrodes, and graphene oxide nanosheets as solid-state electrolyte. The free water molecules trapped between graphene oxide sheets facilitate proton movement through the layered solid electrolyte8. The as-made supercapacitor shows high areal capacitance, good cycling stability and high areal energy and power densities comparable with existing printed supercapacitors. Moreover, the specific capacitance can be increased further by addition of liquid electrolytes.

preprint2020arXiv

Unsupervised Learning of Camera Pose with Compositional Re-estimation

We consider the problem of unsupervised camera pose estimation. Given an input video sequence, our goal is to estimate the camera pose (i.e. the camera motion) between consecutive frames. Traditionally, this problem is tackled by placing strict constraints on the transformation vector or by incorporating optical flow through a complex pipeline. We propose an alternative approach that utilizes a compositional re-estimation process for camera pose estimation. Given an input, we first estimate a depth map. Our method then iteratively estimates the camera motion based on the estimated depth map. Our approach significantly improves the predicted camera motion both quantitatively and visually. Furthermore, the re-estimation resolves the problem of out-of-boundaries pixels in a novel and simple way. Another advantage of our approach is that it is adaptable to other camera pose estimation approaches. Experimental analysis on KITTI benchmark dataset demonstrates that our method outperforms existing state-of-the-art approaches in unsupervised camera ego-motion estimation.

preprint2020arXiv

Unsupervised Vehicle Re-identification with Progressive Adaptation

Vehicle re-identification (reID) aims at identifying vehicles across different non-overlapping cameras views. The existing methods heavily relied on well-labeled datasets for ideal performance, which inevitably causes fateful drop due to the severe domain bias between the training domain and the real-world scenes; worse still, these approaches required full annotations, which is labor-consuming. To tackle these challenges, we propose a novel progressive adaptation learning method for vehicle reID, named PAL, which infers from the abundant data without annotations. For PAL, a data adaptation module is employed for source domain, which generates the images with similar data distribution to unlabeled target domain as ``pseudo target samples''. These pseudo samples are combined with the unlabeled samples that are selected by a dynamic sampling strategy to make training faster. We further proposed a weighted label smoothing (WLS) loss, which considers the similarity between samples with different clusters to balance the confidence of pseudo labels. Comprehensive experimental results validate the advantages of PAL on both VehicleID and VeRi-776 dataset.

preprint2020arXiv

Utilizing machine learning to prevent water main breaks by understanding pipeline failure drivers

Data61 and Western Water worked collaboratively to apply engineering expertise and Machine Learning tools to find a cost-effective solution to the pipe failure problem in the region west of Melbourne, where on average 400 water main failures occur per year. To achieve this objective, we constructed a detailed picture and understanding of the behaviour of the water pipe network by 1) discovering the underlying drivers of water main breaks, and 2) developing a Machine Learning system to assess and predict the failure likelihood of water main breaking using historical failure records, descriptors of pipes, and other environmental factors. The ensuing results open up an avenue for Western Water to identify the priority of pipe renewals

preprint2019arXiv

Alignment between Satellite and Central Galaxies in the EAGLE Simulation: Dependence on the Large-Scale Environments

The alignment between satellite and central galaxies serves as a proxy for addressing the issue of galaxy formation and evolution and has been investigated abundantly in observations and theoretical works. Most scenarios indicate that the satellites preferentially locate along the major axis of their central galaxy. Recent work shows that the strength of alignment signals depends on large-scale environment in observations. We use the publicly-released data from EAGLE to figure out whether the same effect can be found in the hydrodynamic simulation. We found much stronger environmental dependency of alignment signal in simulation. And we also explore change of alignments to address the formation of this effects.

preprint2019arXiv

Alternative Analysis Methods for Time to Event Endpoints under Non-proportional Hazards: A Comparative Analysis

The log-rank test is most powerful under proportional hazards (PH). In practice, non-PH patterns are often observed in clinical trials, such as in immuno-oncology; therefore, alternative methods are needed to restore the efficiency of statistical testing. Three categories of testing methods were evaluated, including weighted log-rank tests, Kaplan-Meier curve-based tests (including weighted Kaplan-Meier and Restricted Mean Survival Time, RMST), and combination tests (including Breslow test, Lee's combo test, and MaxCombo test). Nine scenarios representing the PH and various non-PH patterns were simulated. The power, type I error, and effect estimates of each method were compared. In general, all tests control type I error well. There is not a single most powerful test across all scenarios. In the absence of prior knowledge regarding the PH or non-PH patterns, the MaxCombo test is relatively robust across patterns. Since the treatment effect changes overtime under non-PH, the overall profile of the treatment effect may not be represented comprehensively based on a single measure. Thus, multiple measures of the treatment effect should be pre-specified as sensitivity analyses to evaluate the totality of the data.

preprint2019arXiv

Edge-Epitaxial Growth of InSe Nanowires toward High-Performance Photodetectors

Semiconducting nanowires offer many opportunities for electronic and optoelectronic device applications due to their special geometries and unique physical properties. However, it has been challenging to synthesize semiconducting nanowires directly on SiO2/Si substrate due to lattice mismatch. Here, we developed a catalysis-free approach to achieve direct synthesis of long and straight InSe nanowires on SiO2/Si substrate through edge-homoepitaxial growth. We further achieved parallel InSe nanowires on SiO2/Si substrate through controlling growth conditions. We attributed the underlying growth mechanism to selenium self-driven vapor-liquid-solid process, which is distinct from conventional metal-catalytic vapor-liquid-solid method widely used for growing Si and III-V nanowires. Furthermore, we demonstrated that the as-grown InSe nanowire-based visible light photodetector simultaneously possesses an extraordinary photoresponsivity of 271 A/W, ultrahigh detectivity of 1.57*10^14 Jones and a fast response speed of microsecond scale. The excellent performance of the photodetector indicates that as-grown InSe nanowires are promising in future optoelectronic applications. More importantly, the proposed edge-homoepitaxial approach may open up a novel avenue for direct synthesis of semiconducting nanowire arrays on SiO2/Si substrate.

preprint2019arXiv

Evidence for an Additional Symmetry Breaking from Direct Observation of Band Splitting in the Nematic State of FeSe Superconductor

The iron-based superconductor FeSe has attracted much recent attention because of its simple crystal structure, distinct electronic structure and rich physics exhibited by itself and its derivatives. Determination of its intrinsic electronic structure is crucial to understand its physical properties and superconductivity mechanism. Both theoretical and experimental studies so far have provided a picture that FeSe consists of one hole-like Fermi surface around the Brillouin zone center in its nematic state. Here we report direct observation of two hole-like Fermi surface sheets around the Brillouin zone center, and the splitting of the associated bands, in the nematic state of FeSe by taking high resolution laser-based angle-resolved photoemission measurements. These results indicate that, in addition to nematic order and spin-orbit coupling, there is an additional order in FeSe that breaks either inversion or time reversal symmetries. The new Fermi surface topology asks for reexamination of the existing theoretical and experimental understanding of FeSe and stimulates further efforts to identify the origin of the hidden order in its nematic state.

preprint2019arXiv

Machine Learning the Effective Hamiltonian in High Entropy Alloys

The development of machine learning sheds new light on the problem of statistical thermodynamics in multicomponent alloys. However, a data-driven approach to construct the effective Hamiltonian requires sufficiently large data sets, which is expensive to calculate with conventional density functional theory (DFT). To solve this problem, we propose to use the atomic local energy as the target variable, and harness the power of the linear-scaling DFT to accelerate the data generating process. Using the large amounts of DFT data sets, various complex models are devised and applied to learn the effective Hamiltonians of a range of refractory high entropy alloys (HEAs). The testing $R^2$ scores of the effective pair interaction model are higher than 0.99, demonstrating that the pair interactions within the 6-th coordination shell provide an excellent description of the atomic local energies for all the four HEAs. This model is further improved by including nonlinear and multi-site interactions. In particular, the deep neural networks (DNNs) built directly in the local configuration space (therefore no hand-crafted features) are employed to model the effective Hamiltonian. The results demonstrate that neural networks are promising for the modeling of effective Hamiltonian due to its excellent representation power.

preprint2019arXiv

Quantifying dynamics of failure across science, startups, and security

Human achievements are often preceded by repeated attempts that initially fail, yet little is known about the mechanisms governing the dynamics of failure. Here, building on the rich literature on innovation, human dynamics and learning, we develop a simple one-parameter model that mimics how successful future attempts build on those past. Analytically solving this model reveals a phase transition that separates dynamics of failure into regions of stagnation or progression, predicting that near the critical threshold, agents who share similar characteristics and learning strategies may experience fundamentally different outcomes following failures. Below the critical point, we see those who explore disjoint opportunities without a pattern of improvement, and above it, those who exploit incremental refinements to systematically advance toward success. The model makes several empirically testable predictions, demonstrating that those who eventually succeed and those who do not may be initially similar, yet are characterized by fundamentally distinct failure dynamics in terms of the efficiency and quality of each subsequent attempt. We collected large-scale data from three disparate domains, tracing repeated attempts by (i) NIH investigators to fund their research, (ii) innovators to successfully exit their startup ventures, and (iii) terrorist organizations to post casualties in violent attacks, finding broadly consistent empirical support across all three domains. Together, our findings unveil identifiable yet previously unknown early signals that allow us to identify failure dynamics that will lead to ultimate victory or defeat. Given the ubiquitous nature of failures and the paucity of quantitative approaches to understand them, these results represent a crucial step toward deeper understanding of the complex dynamics beneath failures, the essential prerequisites for success.

preprint2019arXiv

Robust Bang-Off-Bang Low-Thrust Guidance Using Model Predictive Static Programming

Model Predictive Static Programming (MPSP) was always used under the assumption of continuous control, which impedes it for applications with bang-off-bang control directly. In this paper, MPSP is employed for the first time as a guidance scheme for low-thrust transfers with bang-off-bang control where the fuel-optimal trajectory is used as the nominal solution. In our method, dynamical equations in Cartesian coordinates are augmented by the mass costate equation, while the unconstrained velocity costate vector is used as control variable, and is expressed as a combination of Fourier basis functions with corresponding weights. A two-loop MPSP algorithm is designed where the weights and the initial mass costate are updated in the inner loop and continuation is conducted on the outer loop in case of large perturbations. The sensitivity matrix (SM) is recursively calculated using analytical derivatives and SM at switching points is compensated based on calculus of variations. An sample interplanetary CubeSat mission to an asteroid is used as study case to illustrate the effectiveness of the method developed.

preprint2016arXiv

A Bilateral Reserve Market for Variable Generation: Concept and Implementation

Substantial changes in the generation portfolio take place due to the fast growth of renewable energy generation, of which the major types such as wind and solar power have significant forecast uncertainty. Reducing the impacts of uncertainty requires the cooperation of system participants, which are supported by proper market rules and incentives. In this paper, we propose a bilateral reserve market for variable generation (VG) producers and capacity resource providers. In this market, VG producers purchase bilateral reserve services (BRSs) to reduce potential imbalance penalties, and BRS providers earn profits on their available capacity for re-dispatch. We show in this paper that by introducing this product, the VG producers' overall imbalance costs are linked to both their forecast quality and the available system capacity, which follows the cost-causation principle. Case studies demonstrate how the proposed BRS mechanism works and its effectiveness.

preprint2016arXiv

A full-potential approach to the relativistic single-site Green's function

One major purpose of studying the single-site scattering problem is to obtain the scattering matrices and differential equation solutions indispensable to multiple scattering theory (MST) calculations. On the other hand, the single-site scattering itself is also appealing because it reveals the physical environment experienced by electrons around the scattering center. In this paper we demonstrate a new formalism to calculate the relativistic full-potential single-site Green's function. We implement this method to calculate the single-site density of states and electron charge densities. The code is rigorously tested and with the help of Krein's theorem, the relativistic effects and full potential effects in group V elements and noble metals are thoroughly investigated.

preprint2016arXiv

Atomically flat reconstructed rutile TiO2(001) surfaces for oxide film growth

The availability of low-index rutile TiO2 single crystal substrates with atomically flat surfaces is essential for enabling epitaxial growth of rutile transition metal oxide films. The high surface energy of the rutile (001) surface often leads to surface faceting, which precludes the sputter and annealing treatment commonly used for the preparation of clean and atomically flat TiO2(110) substrate surfaces. In this work, we reveal that stable and atomically flat rutile TiO2(001) surfaces can be prepared with an atomically ordered reconstructed surface already during a furnace annealing treatment in air. We tentatively ascribe this result to the decrease in surface energy associated with the surface reconstruction, which removes the driving force for faceting. Despite the narrow temperature window where this morphology can initially be formed, we demonstrate that it persists in homoepitaxial growth of TiO2(001) thin films. The stabilization of surface reconstructions that prevent faceting of high-surface-energy crystal faces may offer a promising avenue towards the realization of a wider range of high quality epitaxial transition metal oxide heterostructures.

preprint2016arXiv

Detector-decoy high-dimensional quantum key distribution

The decoy-state high-dimensional quantum key distribution provides a practical secure way to share more private information with high photon-information efficiency. In this paper, based on detector-decoy method, we propose a detector-decoy high-dimensional quantum key distribution protocol. Employing threshold detectors and a variable attenuator, we can estimate single-photon fraction of postselected events and Eves Holevo information under the Gaussian collective attack with much simpler operations in practical implementation. By numerical evaluation, we show that without varying source intensity and optimizing decoy-state intensity, our protocol could perform much better than one-decoy-state protocol and as well as the two-decoy-state protocol. Specially, when the detector efficiency is lower, the advantage of the detector-decoy method becomes more prominent.

preprint2016arXiv

Electronic structure of the ingredient planes of cuprate superconductor Bi2Sr2CuO6+δ: a comparison study with Bi2Sr2CaCu2O8+δ

By means of low-temperature scanning tunneling microscopy, we report on the electronic structures of BiO and SrO planes of Bi2Sr2CuO6+δ (Bi-2201) superconductor prepared by argon-ion bombardment and annealing. Depending on post annealing conditions, the BiO planes exhibit either pseudogap (PG) with sharp coherence peaks and an anomalously large gap of 49 meV or van Hove singularity (VHS) near the Fermi level, while the SrO is always characteristic of a PG-like feature. This contrasts with Bi2Sr2CaCu2O8+δ (Bi-2212) superconductor where VHS occurs solely on the SrO plane. We disclose the interstitial oxygen dopants (δ in the formulas) as a primary cause for the occurrence of VHS, which are located dominantly around the BiO and SrO planes, respectively, in Bi-2201 and Bi-2212. This is supported by the contrasting structural buckling amplitude of BiO and SrO planes in the two superconductors. Our findings provide solid evidence for the irrelevance of PG to the superconductivity in the two superconductors, as well as insights into why Bi-2212 can achieve a higher superconducting transition temperature than Bi-2201, and by implication, the mechanism of cuprate superconductivity.

preprint2016arXiv

Fast Phase Retrieval from Local Correlation Measurements

We develop a fast phase retrieval method which can utilize a large class of local phaseless correlation-based measurements in order to recover a given signal ${\bf x} \in \mathbb{C}^d$ (up to an unknown global phase) in near-linear $\mathcal{O} \left( d \log^4 d \right)$-time. Accompanying theoretical analysis proves that the proposed algorithm is guaranteed to deterministically recover all signals ${\bf x}$ satisfying a natural flatness (i.e., non-sparsity) condition for a particular choice of deterministic correlation-based measurements. A randomized version of these same measurements is then shown to provide nonuniform probabilistic recovery guarantees for arbitrary signals ${\bf x} \in \mathbb{C}^d$. Numerical experiments demonstrate the method's speed, accuracy, and robustness in practice -- all code is made publicly available. Finally, we conclude by developing an extension of the proposed method to the sparse phase retrieval problem; specifically, we demonstrate a sublinear-time compressive phase retrieval algorithm which is guaranteed to recover a given $s$-sparse vector ${\bf x} \in \mathbb{C}^d$ with high probability in just $\mathcal{O}(s \log^5 s \cdot \log d)$-time using only $\mathcal{O}(s \log^4 s \cdot \log d)$ magnitude measurements. In doing so we demonstrate the existence of compressive phase retrieval algorithms with near-optimal linear-in-sparsity runtime complexities.

preprint2016arXiv

Finite-key analysis of a practical decoy-state high-dimensional quantum key distribution

Compared with two-level quantum key distribution (QKD), highdimensional QKD enable two distant parties to share a secret key at a higher rate. We provide a finite-key security analysis for the recently proposed practical highdimensional decoy-state QKD protocol based on time-energy entanglement. We employ two methods to estimate the statistical fluctuation of the postselection probability and give a tighter bound on the secure-key capacity. By numerical evaluation, we show the finite-key effect on the secure-key capacity in different conditions. Moreover, our approach could be used to optimize parameters in practical implementations of highdimensional QKD.

preprint2016arXiv

Fourier bases and Fourier frames on self-affine measures

This paper gives a review of the recent progress in the study of Fourier bases and Fourier frames on self-affine measures. In particular, we emphasize the new matrix analysis approach for checking the completeness of a mutually orthogonal set. This method helps us settle down a long-standing conjecture that Hadamard triples generates self-affine spectral measures. It also gives us non-trivial examples of fractal measures with Fourier frames. Furthermore, a new avenue is open to investigate whether the Middle Third Cantor measure admits Fourier frames.

preprint2016arXiv

Generalized phase retrieval : measurement number, matrix recovery and beyond

In this paper, we develop a framework of generalized phase retrieval in which one aims to reconstruct a vector ${\mathbf x}$ in ${\mathbb R}^d$ or ${\mathbb C}^d$ through quadratic samples ${\mathbf x}^*A_1{\mathbf x}, \dots, {\mathbf x}^*A_N{\mathbf x}$. The generalized phase retrieval includes as special cases the standard phase retrieval as well as the phase retrieval by orthogonal projections. We first explore the connections among generalized phase retrieval, low-rank matrix recovery and nonsingular bilinear form. Motivated by the connections, we present results on the minimal measurement number needed for recovering a matrix that lies in a set $W\in {\mathbb C}^{d\times d}$. Applying the results to phase retrieval, we show that generic $d \times d$ matrices $A_1,\ldots, A_N$ have the phase retrieval property if $N\geq 2d-1$ in the real case and $N \geq 4d-4$ in the complex case for very general classes of $A_1,\ldots,A_N$, e.g. matrices with prescribed ranks or orthogonal projections. Our method also leads to a novel proof for the classical Stiefel-Hopf condition on nonsingular bilinear form. We also give lower bounds on the minimal measurement number required for generalized phase retrieval. For several classes of dimensions $d$ we obtain the precise values of the minimal measurement number. Our work unifies and enhances results from the standard phase retrieval, phase retrieval by projections and low-rank matrix recovery.

preprint2016arXiv

Improving Human Action Recognition by Non-action Classification

In this paper we consider the task of recognizing human actions in realistic video where human actions are dominated by irrelevant factors. We first study the benefits of removing non-action video segments, which are the ones that do not portray any human action. We then learn a non-action classifier and use it to down-weight irrelevant video segments. The non-action classifier is trained using ActionThread, a dataset with shot-level annotation for the occurrence or absence of a human action. The non-action classifier can be used to identify non-action shots with high precision and subsequently used to improve the performance of action recognition systems.

preprint2016arXiv

Iterative Views Agreement: An Iterative Low-Rank based Structured Optimization Method to Multi-View Spectral Clustering

Multi-view spectral clustering, which aims at yielding an agreement or consensus data objects grouping across multi-views with their graph laplacian matrices, is a fundamental clustering problem. Among the existing methods, Low-Rank Representation (LRR) based method is quite superior in terms of its effectiveness, intuitiveness and robustness to noise corruptions. However, it aggressively tries to learn a common low-dimensional subspace for multi-view data, while inattentively ignoring the local manifold structure in each view, which is critically important to the spectral clustering; worse still, the low-rank minimization is enforced to achieve the data correlation consensus among all views, failing to flexibly preserve the local manifold structure for each view. In this paper, 1) we propose a multi-graph laplacian regularized LRR with each graph laplacian corresponding to one view to characterize its local manifold structure. 2) Instead of directly enforcing the low-rank minimization among all views for correlation consensus, we separately impose low-rank constraint on each view, coupled with a mutual structural consensus constraint, where it is able to not only well preserve the local manifold structure but also serve as a constraint for that from other views, which iteratively makes the views more agreeable. Extensive experiments on real-world multi-view data sets demonstrate its superiority.

preprint2016arXiv

Nodeless pairing in superconducting copper-oxide monolayer films on Bi2Sr2CaCu2O8+δ

The pairing mechanism of high-temperature superconductivity in cuprates remains the biggest unresolved mystery in condensed matter physics. To solve the problem, one of the most effective approaches is to investigate directly the superconducting CuO2 layers. Here, by growing CuO2 monolayer films on Bi2Sr2CaCu2O8+δ substrates, we identify two distinct and spatially separated energy gaps centered at the Fermi energy, a smaller U-like gap and a larger V-like gap on the films, and study their interactions with alien atoms by low-temperature scanning tunneling microscopy. The newly discovered U-like gap exhibits strong phase coherence and is immune to scattering by K, Cs and Ag atoms, suggesting its nature as a nodeless superconducting gap in the CuO2 layers, whereas the V-like gap agrees with the well-known pseudogap state in the underdoped regime. Our results support an s-wave superconductivity in Bi2Sr2CaCu2O8+δ, which, we propose, originates from the modulation-doping resultant two-dimensional hole liquid confined in the CuO2 layers.

preprint2016arXiv

Phase Retrieval From the Magnitudes of Affine Linear Measurements

In this paper, we consider the phase retrieval problem in which one aims to recover a signal from the magnitudes of affine measurements. Let $\{{\mathbf a}_j\}_{j=1}^m \subset {\mathbb H}^d$ and ${\mathbf b}=(b_1, \ldots, b_m)^\top\in{\mathbb H}^m$, where ${\mathbb H}={\mathbb R}$ or ${\mathbb C}$. We say $\{{\mathbf a}_j\}_{j=1}^m$ and $\mathbf b$ are affine phase retrievable for ${\mathbb H}^d$ if any ${\mathbf x}\in{\mathbb H}^d$ can be recovered from the magnitudes of the affine measurements $\{|<{\mathbf a}_j,{\mathbf x}>+b_j|,\, 1\leq j\leq m\}$. We develop general framework for affine phase retrieval and prove necessary and sufficient conditions for $\{{\mathbf a}_j\}_{j=1}^m$ and $\mathbf b$ to be affine phase retrievable. We establish results on minimal measurements and generic measurements for affine phase retrieval as well as on sparse affine phase retrieval. In particular, we also highlight some notable differences between affine phase retrieval and the standard phase retrieval in which one aims to recover a signal $\mathbf x$ from the magnitudes of its linear measurements. In standard phase retrieval, one can only recover $\mathbf x$ up to a unimodular constant, while affine phase retrieval removes this ambiguity. We prove that unlike standard phase retrieval, the affine phase retrievable measurements $\{{\mathbf a}_j\}_{j=1}^m$ and $\mathbf b$ do not form an open set in ${\mathbb H}^{m\times d}\times {\mathbb H}^m$. Also in the complex setting, the standard phase retrieval requires $4d-O(\log_2d)$ measurements, while the affine phase retrieval only needs $m=3d$ measurements.

preprint2016arXiv

Practical decoy-state round-robin differential-phaseshift quantum key distribution

To overcome the signal disturbance from the transmission process, recently, a new type of protocol named round-robin differential-phase-shift(RRDPS) quantum key distribution[Nature 509, 475(2014)] is proposed. It can estimate how much information has leaked to eavesdropper without monitoring bit error rates. In this paper, we compare the performance of RRDPS using different sources without and with decoy-state method, such as weak coherent pulses(WCPs) and heralded single photon source(HSPS). For practical implementations, we propose finite decoy-state method for RRDPS, the performance of which is close to the infinite one. Taking WCPs as an example, the three-intensity decoystate protocol can distribute secret keys over a distance of 128 km when the length of pulses packet is 32, which confirms the great practical interest of our method.

preprint2016arXiv

PrivLogit: Efficient Privacy-preserving Logistic Regression by Tailoring Numerical Optimizers

Safeguarding privacy in machine learning is highly desirable, especially in collaborative studies across many organizations. Privacy-preserving distributed machine learning (based on cryptography) is popular to solve the problem. However, existing cryptographic protocols still incur excess computational overhead. Here, we make a novel observation that this is partially due to naive adoption of mainstream numerical optimization (e.g., Newton method) and failing to tailor for secure computing. This work presents a contrasting perspective: customizing numerical optimization specifically for secure settings. We propose a seemingly less-favorable optimization method that can in fact significantly accelerate privacy-preserving logistic regression. Leveraging this new method, we propose two new secure protocols for conducting logistic regression in a privacy-preserving and distributed manner. Extensive theoretical and empirical evaluations prove the competitive performance of our two secure proposals while without compromising accuracy or privacy: with speedup up to 2.3x and 8.1x, respectively, over state-of-the-art; and even faster as data scales up. Such drastic speedup is on top of and in addition to performance improvements from existing (and future) state-of-the-art cryptography. Our work provides a new way towards efficient and practical privacy-preserving logistic regression for large-scale studies which are common for modern science.

preprint2016arXiv

Robust Hashing for Multi-View Data: Jointly Learning Low-Rank Kernelized Similarity Consensus and Hash Functions

Learning hash functions/codes for similarity search over multi-view data is attracting increasing attention, where similar hash codes are assigned to the data objects characterizing consistently neighborhood relationship across views. Traditional methods in this category inherently suffer three limitations: 1) they commonly adopt a two-stage scheme where similarity matrix is first constructed, followed by a subsequent hash function learning; 2) these methods are commonly developed on the assumption that data samples with multiple representations are noise-free,which is not practical in real-life applications; 3) they often incur cumbersome training model caused by the neighborhood graph construction using all $N$ points in the database ($O(N)$). In this paper, we motivate the problem of jointly and efficiently training the robust hash functions over data objects with multi-feature representations which may be noise corrupted. To achieve both the robustness and training efficiency, we propose an approach to effectively and efficiently learning low-rank kernelized \footnote{We use kernelized similarity rather than kernel, as it is not a squared symmetric matrix for data-landmark affinity matrix.} hash functions shared across views. Specifically, we utilize landmark graphs to construct tractable similarity matrices in multi-views to automatically discover neighborhood structure in the data. To learn robust hash functions, a latent low-rank kernel function is used to construct hash functions in order to accommodate linearly inseparable data. In particular, a latent kernelized similarity matrix is recovered by rank minimization on multiple kernel-based similarity matrices. Extensive experiments on real-world multi-view datasets validate the efficacy of our method in the presence of error corruptions.

preprint2016arXiv

Sussing Merger Trees: Stability and Convergence

Merger trees are routinely used to follow the growth and merging history of dark matter haloes and subhaloes in simulations of cosmic structure formation. Srisawat et al. (2013) compared a wide range of merger-tree-building codes. Here we test the influence of output strategies and mass resolution on tree-building. We find that, somewhat surprisingly, building the tree from more snapshots does not generally produce more complete trees; instead, it tends to short- en them. Significant improvements are seen for patching schemes which attempt to bridge over occasional dropouts in the underlying halo catalogues or schemes which combine the halo-finding and tree-building steps seamlessly. The adopted output strategy does not affec- t the average number of branches (bushiness) of the resultant merger trees. However, mass resolution has an influence on both main branch length and the bushiness. As the resolution increases, a halo with the same mass can be traced back further in time and will encounter more small progenitors during its evolutionary history. Given these results, we recommend that, for simulations intended as precursors for galaxy formation models where of order 100 or more snapshots are analysed, the tree-building routine should be integrated with the halo finder, or at the very least be able to patch over multiple adjacent snapshots.

preprint2016arXiv

TaskMe: Multi-Task Allocation in Mobile Crowd Sensing

Task allocation or participant selection is a key issue in Mobile Crowd Sensing (MCS). While previous participant selection approaches mainly focus on selecting a proper subset of users for a single MCS task, multi-task-oriented participant selection is essential and useful for the efficiency of large-scale MCS platforms. This paper proposes TaskMe, a participant selection framework for multi-task MCS environments. In particular, two typical multi-task allocation situations with bi-objective optimization goals are studied: (1) For FPMT (few participants, more tasks), each participant is required to complete multiple tasks and the optimization goal is to maximize the total number of accomplished tasks while minimizing the total movement distance. (2) For MPFT (more participants, few tasks), each participant is selected to perform one task based on pre-registered working areas in view of privacy, and the optimization objective is to minimize total incentive payments while minimizing the total traveling distance. Two optimal algorithms based on the Minimum Cost Maximum Flow theory are proposed for FPMT, and two algorithms based on the multi-objective optimization theory are proposed for MPFT. Experiments verify that the proposed algorithms outperform baselines based on a large-scale real-word dataset under different experiment settings (the number of tasks, various task distributions, etc.).

preprint2016arXiv

Universal gates based on targeted phase shifts in a 3D neutral atom array

Although the quality of quantum bits (qubits) and quantum gates has been steadily improving, the available quantity of qubits has increased quite slowly. To address this important issue in quantum computing, we have demonstrated arbitrary single qubit gates based on targeted phase shifts, an approach that can be applied to atom, ion or other atom-like systems. These gates are highly insensitive to addressing beam imperfections and have little crosstalk, allowing for a dramatic scaling up of qubit number. We have performed gates in series on 48 individually targeted sites in a 40% full $5\times 5\times 5$ 3D array created by an optical lattice. Using randomized benchmarking, we demonstrate an average gate fidelity of 0.9962(16), with an average crosstalk fidelity of 0.9979(2).

preprint2015arXiv

A new approach for physiological time series

We developed a new approach for the analysis of physiological time series. An iterative convolution filter is used to decompose the time series into various components. Statistics of these components are extracted as features to characterize the mechanisms underlying the time series. Motivated by the studies that show many normal physiological systems involve irregularity while the decrease of irregularity usually implies the abnormality, the statistics for "outliers" in the components are used as features measuring irregularity. Support vector machines are used to select the most relevant features that are able to differentiate the time series from normal and abnormal systems. This new approach is successfully used in the study of congestive heart failure by heart beat interval time series.

preprint2015arXiv

Applying the $χ^2$ Regularization Parameter Estimator by Downsampling Through Relations with The Singular Value Expansion

The solution, $x$, of the linear system of equations $A x\approx b$ arising from the discretization of an ill-posed integral equation with a square integrable kernel $H(s,t)$ is considered. The Tikhonov regularized solution $ x(λ)$ is found as the minimizer of $J( x)=\{ \|A x - b\|_2^2 + λ^2 \|L x\|_2^2\}$. $ x(λ)$ depends on regularization parameter $λ$ that trades off the data fidelity, and on the smoothing norm determined by $L$. Here we consider the case where $L$ is diagonal and invertible, and employ the Galerkin method to provide the relationship between the singular value expansion and the singular value decomposition for square integrable kernels. The resulting approximation of the integral equation permits examination of the properties of the regularized solution $ x(λ)$ independent of the sample size of the data. We prove that estimation of the regularization parameter can be obtained by consistently down sampling the data and the system matrix, leading to solutions of coarse to fine grained resolution. Hence, the estimate of $λ$ for a large problem may be found by downsampling to a smaller problem, or to a set of smaller problems, effectively moving the costly estimate of the regularization parameter to the coarse representation of the problem. Moreover, the full singular value decomposition for the fine scale system is replaced by a number of dominant terms which is determined from the coarse resolution system, again reducing the computational cost. Numerical results illustrate the theory and demonstrate the practicality of the approach for regularization parameter estimation using generalized cross validation, unbiased predictive risk estimation and the discrepancy principle applied for both the system of equations, and the augmented system of equations.

preprint2015arXiv

Coherent addressing of individual neutral atoms in a 3D optical lattice

We demonstrate arbitrary coherent addressing of individual neutral atoms in a $5\times 5\times 5$ array formed by an optical lattice. Addressing is accomplished using rapidly reconfigurable crossed laser beams to selectively ac Stark shift target atoms, so that only target atoms are resonant with state-changing microwaves. The effect of these targeted single qubit gates on the quantum information stored in non-targeted atoms is smaller than $3\times 10^{-3}$ in state fidelity. This is an important step along the path of converting the scalability promise of neutral atoms into reality.

preprint2015arXiv

Kinetics and thermodynamics of reversible polymerization in closed systems

Motivated by a recent work on the metabolism of carbohydrates in bacteria, we study the kinetics and thermodynamics of two classic models for reversible polymerization, one preserving the total polymer concentration and the other one not. The chemical kinetics is described by rate equations following the mass-action law. We consider a closed system and nonequilibrium initial conditions and show that the system dynamically evolves towards equilibrium where detailed balance is satisfied. The entropy production during this process can be expressed as the time derivative of a Lyapunov function. When the solvent is not included in the description and the dynamics conserves the total concentration of polymer, the Lyapunov function can be expressed as a Kullback-Leibler divergence between the nonequilibrium and the equilibrium polymer length distribution. The same result holds true when the solvent is explicitly included in the description and the solution is assumed dilute, whether or not the total polymer concentration is conserved. Furthermore, in this case a consistent nonequilibrium thermodynamic formulation can be established and the out-of-equilibrium thermodynamic enthalpy, entropy and free energy can be identified. Such a framework is useful in complementing standard kinetics studies with the dynamical evolution of thermodynamic quantities during polymerization.

preprint2015arXiv

Local spectroscopy of moiré-induced electronic structure in gate-tunable twisted bilayer graphene

Twisted bilayer graphene (tBLG) forms a quasicrystal whose structural and electronic properties depend on the angle of rotation between its layers. Here we present a scanning tunneling microscopy study of gate-tunable tBLG devices supported by atomically-smooth and chemically inert hexagonal boron nitride (BN). The high quality of these tBLG devices allows identification of coexisting moiré patterns and moiré super-superlattices produced by graphene-graphene and graphene-BN interlayer interactions. Furthermore, we examine additional tBLG spectroscopic features in the local density of states beyond the first van Hove singularity. Our experimental data is explained by a theory of moiré bands that incorporates ab initio calculations and confirms the strongly non-perturbative character of tBLG interlayer coupling in the small twist-angle regime.

preprint2015arXiv

Mapping the Electronic Structure of Each Ingredient Oxide Layer of High-$T_\textrm{c}$ Cuprate Superconductor Bi2Sr2CaCu2O8+δ

Understanding the mechanism of high transition temperature (Tc) superconductivity in cuprates has been hindered by the apparent complexity of their multilayered crystal structure. Using a cryogenic scanning tunneling microscopy, we report on layer-by-layer probing of the electronic structures of all ingredient planes (BiO, SrO, CuO2) of Bi2Sr2CaCu2O8+δ superconductor prepared by argon-ion bombardment and annealing technique. We show that the well-known pseudogap (PG) feature observed by STM is inherently a property of the BiO planes and thus irrelevant directly to Cooper pairing. The SrO planes exhibit an unexpected Van Hove singularity near the Fermi level, while the CuO2 planes are exclusively characterized by a smaller gap inside the PG. The small gap becomes invisible near Tc, which we identify as the superconducting gap. The above results constitute severe constraints on any microscopic model for high Tc superconductivity in cuprates.

preprint2015arXiv

Mechanism for femtosecond laser-induced periodic subwavelength structures on solid surface: surface two-plasmon resonance

We present that surface two-plasmon resonance (STPR) in electron plasma sheet produced by femtosecond laser irradiating metal surface is the self-formation mechanism of periodic subwavelength ripple structures. Peaks of overdense electrons formed by resonant two-plasmon wave pull bound ions out of the metal surface and thus the wave pattern of STPR is "carved" on the surface by Coulomb ablation (removal) resulting from the strong electrostatic field induced by charge separation. To confirm the STPR model, we have performed analogical carving experiments by two laser beams with perpendicular polarizations. The results explicitly show that two wave patterns of STPR are independently carved on the exposure area of target surface. The time-scale of ablation dynamics and the electron temperature in ultrafast interaction are also verified by time-resolved spectroscopy experiment and numerical simulation, respectively. The present model can self-consistently explain the formation of subwavelength ripple structures even with spatial periods shorter than half of the laser wavelength, shedding light on the understanding of ultrafast laser-solid interaction.

preprint2015arXiv

Observing Atomic Collapse Resonances in Artificial Nuclei on Graphene

Relativistic quantum mechanics predicts that when the charge of a superheavy atomic nucleus surpasses a certain threshold, the resulting strong Coulomb field causes an unusual atomic collapse state; this state exhibits an electron wave function component that falls toward the nucleus, as well as a positron component that escapes to infinity. In graphene, where charge carriers behave as massless relativistic particles, it has been predicted that highly charged impurities should exhibit resonances corresponding to these atomic collapse states. We have observed the formation of such resonances around artificial nuclei (clusters of charged calcium dimers) fabricated on gated graphene devices via atomic manipulation with a scanning tunneling microscope. The energy and spatial dependence of the atomic collapse state measured with scanning tunneling microscopy revealed unexpected behavior when occupied by electrons.

preprint2015arXiv

Oceanic El-Niño wave dynamics and climate networks

Oceanic Kelvin and Rossby waves play an important role in tropical climate and \en dynamics. Here we develop and apply a climate network approach to quantify the characteristics of \en related oceanic waves, based on sea surface height satellite data. We associate the majority of dominant long distance ($\geq 500$ km) links of the network with (i) equatorial Kelvin waves, (ii) off-equatorial Rossby waves, and (iii) tropical instability waves. Notably, we find that the location of the hubs of out-going ($\sim 180^{\circ}\rm{E}$) and in-coming ($\sim 140^{\circ}\rm{W}$) links of the climate network coincide with the locations of the Kelvin wave initiation and dissipation, respectively. We also find that this dissipation at $\sim 140^{\circ}\rm{W}$ is much weaker during \en times. Moreover, the hubs of the off-equatorial network coincide with the locations of westerly wind burst activity and high wind vorticity, two mechanisms that were associated with Rossby waves activity. The quantitative methodology and measures developed here can improve the understanding of \en dynamics and possibly its prediction.

preprint2015arXiv

rnn : Recurrent Library for Torch

The rnn package provides components for implementing a wide range of Recurrent Neural Networks. It is built withing the framework of the Torch distribution for use with the nn package. The components have evolved from 3 iterations, each adding to the flexibility and capability of the package. All component modules inherit either the AbstractRecurrent or AbstractSequencer classes. Strong unit testing, continued backwards compatibility and access to supporting material are the principles followed during its development. The package is compared against existing implementations of two published papers.

preprint2015arXiv

Simulations of the spatial and temporal invariance in the spectra of gradual solar energetic particle events

The spatial and temporal invariance in the spectra of energetic particles in the gradual solar events is reproduced in the simulations. Based on a numerical solution of the focused transport equation, we obtain the intensity time profiles of solar energetic particles (SEPs) accelerated by an interplanetary shock in the three-dimensional interplanetary space. The shock is treated as a moving source of energetic particles with a distribution function. The time profiles of particle flux with different energies are calculated in the ecliptic at $1$ AU. According to our model, we find that shock acceleration strength, parallel diffusion and adiabatic cooling are the main factors in forming the spatial invariance in SEP spectra, and perpendicular diffusion is a secondary factor. In addition, the temporal invariance in SEP spectra is mainly due to the effect of adiabatic cooling. Furthermore, a spectra invariant region, which agrees with observations but is different than the one suggested by Reames and co-workers, is proposed based on our simulations.

preprint2015arXiv

Solving the puzzle of subhalo spins

Investigating the spin parameter distribution of subhaloes in two high resolution isolated halo simulations, re- cent work by Onions et al. suggested that typical subhalo spins are consistently lower than the spin distribution found for field haloes. To further examine this puzzle, we have analyzed simulations of a cosmological volume with sufficient resolution to resolve a significant subhalo population. We confirm the result of Onions et al. and show that the typical spin of a subhalo decreases with decreasing mass and increasing proximity to the host halo center. We interpret this as the growing influence of tidal stripping in removing the outer layers, and hence the higher angular momentum particles, of the subhaloes as they move within the host potential. Investigating the redshift dependence of this effect, we find that the typical subhalo spin is smaller with decreasing redshift. This indicates a temporal evolution as expected in the tidal stripping scenario.

preprint2015arXiv

Stable Signal Recovery from Phaseless Measurements

The aim of this paper is to study the stability of the $\ell_1$ minimization for the compressive phase retrieval and to extend the instance-optimality in compressed sensing to the real phase retrieval setting. We first show that the $m={\mathcal O}(k\log(N/k))$ measurements is enough to guarantee the $\ell_1$ minimization to recover $k$-sparse signals stably provided the measurement matrix $A$ satisfies the strong RIP property. We second investigate the phaseless instance-optimality with presenting a null space property of the measurement matrix $A$ under which there exists a decoder $Δ$ so that the phaseless instance-optimality holds. We use the result to study the phaseless instance-optimality for the $\ell_1$ norm. The results build a parallel for compressive phase retrieval with the classical compressive sensing.

preprint2015arXiv

Whether the Classical O-C Diagram can be used to Multi-mode Pulsators

O-C diagram is a useful technique to analyse the period changes of a pulsator by using the maximum (or minimum) value points which have been obtained from the historical data. But if an object is a double-mode or multi-mode pulsator, the extreme value points are the results of all the modes other than just the fundamental mode. We discussed these situations and give out some criteria to judge whether the O-C diagram can be used in these situations.

preprint2014arXiv

ARPES insights on the metallic states of YbB6(001): E(k) dispersion, temporal changes and spatial variation

We report high resolution Angle Resolved PhotoElectron Spectroscopy (ARPES) results on the (001) cleavage surface of YbB$_{6}$, a rare-earth compound which has been recently predicted to host surface electronic states with topological character. We observe two types of well-resolved metallic states, whose Fermi contours encircle the time-reversal invariant momenta of the YbB$_{6}$(001) surface Brillouin zone, and whose full (E,$k$)-dispersion relation can be measured wholly unmasked by states from the rest of the electronic structure. Although the two-dimensional character of these metallic states is confirmed by their lack of out-of-plane dispersion, two new aspects are revealed in these experiments. Firstly, these states do not resemble two branches of opposite, linear velocity that cross at a Dirac point, but rather straightforward parabolas which terminate to high binding energy with a clear band bottom. Secondly, these states are sensitive to time-dependent changes of the YbB$_{6}$ surface under ultrahigh vacuum conditions. Adding the fact that these data from cleaved YbB$_{6}$ surfaces also display spatial variations in the electronic structure, it appears there is little in common between the theoretical expectations for an idealized YbB$_{6}$(001) crystal truncation on the one hand, and these ARPES data from real cleavage surfaces on the other.

preprint2014arXiv

Gabor orthonormal bases generated by the unit cubes

We consider the problem in determining the countable sets $Λ$ in the time-frequency plane such that the Gabor system generated by the time-frequency shifts of the window $χ_{[0,1]^d}$ associated with $Λ$ forms a Gabor orthonormal basis for $ L^2({\Bbb R}^d)$. We show that, if this is the case, the translates by elements $Λ$ of the unit cube in ${\Bbb R}^{2d}$ must tile the time-frequency space ${\Bbb R}^{2d}$. By studying the possible structure of such tiling sets, we completely classify all such admissible sets $Λ$ of time-frequency shifts when $d=1,2$. Moreover, an inductive procedure for constructing such sets $Λ$ in dimension $d\ge 3$ is also given. An interesting and surprising consequence of our results is the existence, for $d\geq 2$, of discrete sets $Λ$ with ${\mathcal G}(χ_{[0,1]^d},Λ)$ forming a Gabor orthonormal basis but with the associated "time"-translates of the window $χ_{[0,1]^d}$ having significant overlaps.

preprint2014arXiv

High-Quality BN-Graphene-BN Nanoribbon Capacitors Modulated by Graphene Side-gate Electrodes

High-quality BN-Graphene-BN nanoribbon capacitors with double side-gates of graphene are experimentally realized. Graphene electronic properties can be significantly modulated by the double side-gates. The modulation effects are very obvious and followed the metallic electrode behavior of numerical simulations, while the theoretically predicted negative quantum capacitance was not observed, possibility due to the over-estimated or weakened interactions between the graphene nanoribbon and side-gate electrodes.

preprint2014arXiv

Multiple Authors Detection: A Quantitative Analysis of Dream of the Red Chamber

Inspired by the authorship controversy of Dream of the Red Chamber and the application of machine learning in the study of literary stylometry, we develop a rigorous new method for the mathematical analysis of authorship by testing for a so-called chrono-divide in writing styles. Our method incorporates some of the latest advances in the study of authorship attribution, particularly techniques from support vector machines. By introducing the notion of relative frequency as a feature ranking metric our method proves to be highly effective and robust. Applying our method to the Cheng-Gao version of Dream of the Red Chamber has led to convincing if not irrefutable evidence that the first $80$ chapters and the last $40$ chapters of the book were written by two different authors. Furthermore, our analysis has unexpectedly provided strong support to the hypothesis that Chapter 67 was not the work of Cao Xueqin either. We have also tested our method to the other three Great Classical Novels in Chinese. As expected no chrono-divides have been found. This provides further evidence of the robustness of our method.

preprint2014arXiv

Passive decoy-state quantum key distribution for the weak coherent photon source with intensity fluctuations

Passive decoy-state quantum key distribution (QKD) systems, proven to be more desirable than active ones in some scenarios, also have the problem of device imperfections like intensity fluctuations. In this paper the formular of key generation rate of the passive decoy-state protocol using transformed weak coherent pulse (WCP) source with intensity fluctuation is given, and then the influence of intensity fluctuations on the performance of passive decoy-state protocol is rigorously characterized. From numerical simulations, it can be easily seen that intensity fluctuations have unignorable influence on performance of the passive decoy-state QKD protocol with WCP source. Most importantly, our simulations show that, under the same deviation of intensity fluctuations, the passive decoy-state method performs better than the active two-intensity decoy-state method and close to active three-intensity decoy-state method.

preprint2014arXiv

Phase-encoded measurement device independent quantum key distribution with practical spontaneous parametric-down-conversion sources

Measurement-device-independent quantum key distribution (MDI-QKD) with weak coherent sources has been widely and meticulously analyzed. However, the analysis for MDI-QKD with spontaneous parametric-down-conversion sources (SPDCS) is incomplete. In this paper, by accounting for practical parameters of SPDCS with thermal distribution, we presents an investigation on the performances of MDI-QKD under the active three-intensity decoy protocol and the passive one-intensity decoy protocol respectively. Phase randomization, inherently prerequisite for decoy protocol, is taken into consideration for evaluating the overall quantum bit gain and quantum bit error rate. The numerical simulations show that MDI-QKD using SPDCS with practical decoy protocols can be demonstrated comparable to the asymptotical case with infinite decoy states and has apparent superiority both in transmission distance and key generation rate compared to the MDI-QKD using weak coherent sources. Our results also indicate that MDI-QKD using thermal distributed SPDCS with active three-intensity decoy protocol performs better than the one with passive one-intensity decoy protocol.

preprint2014arXiv

Probing the Electron States and Metal-Insulator Transition Mechanisms in Atomically Thin MoS2 Based on Vertical Heterostructures

The metal-insulator transition (MIT) is one of the remarkable electrical transport properties of atomically thin molybdenum disulphide (MoS2). Although the theory of electron-electron interactions has been used in modeling the MIT phenomena in MoS2, the underlying mechanism and detailed MIT process still remain largely unexplored. Here, we demonstrate that the vertical metal-insulator-semiconductor (MIS) heterostructures built from atomically thin MoS2 (monolayers and multilayers) are ideal capacitor structures for probing the electron states in MoS2. The vertical configuration of MIS heterostructures offers the added advantage of eliminating the influence of large impedance at the band tails and allows the observation of fully excited electron states near the surface of MoS2 over a wide excitation frequency (100 Hz-1 MHz) and temperature range (2 K- 300 K). By combining capacitance and transport measurements, we have observed a percolation-type MIT, driven by density inhomogeneities of electron states, in the vertical heterostructures built from monolayer and multilayer MoS2. In addition, the valence band of thin MoS2 layers and their intrinsic properties such as thickness-dependence screening abilities and band gap widths can be easily accessed and precisely determined through the vertical heterostructures.

preprint2014arXiv

Random Matrices and Erasure Robust Frames

Data erasure can often occur in communication. Guarding against erasures involves redundancy in data representation. Mathematically this may be achieved by redundancy through the use of frames. One way to measure the robustness of a frame against erasures is to examine the worst case condition number of the frame with a certain number of vectors erased from the frame. The term {\em numerically erasure-robust frames (NERFs)} was introduced in \cite{FicMix12} to give a more precise characterization of erasure robustness of frames. In the paper the authors established that random frames whose entries are drawn independently from the standard normal distribution can be robust against up to approximately 15\% erasures, and asked whether there exist frames that are robust against erasures of more than 50\%. In this paper we show that with very high probability random frames are, independent of the dimension, robust against any amount of erasures as long as the number of remaining vectors is at least $1+δ$ times the dimension for some $δ_0>0$. This is the best possible result, and it also implies that the proportion of erasures can arbitrarily close to 1 while still maintaining robustness. Our result depends crucially on a new estimate for the smallest singular value of a rectangular random matrix with independent standard normal entries.

preprint2014arXiv

Self-similar subsets of the Cantor set

In this paper, we study the following question raised by Mattila in 1998: what are the self-similar subsets of the middle-third Cantor set $\C$? We give criteria for a complete classification of all such subsets. We show that for any self-similar subset $\F$ of $\C$ containing more than one point every linear generating IFS of $\F$ must consist of similitudes with contraction ratios $\pm 3^{-n}$, $n\in \N$. In particular, a simple criterion is formulated to characterize self-similar subsets of $\C$ with equal contraction ratio in modulus.

preprint2014arXiv

The Chaos of Propagation in a Retrial Supermarket Model

When decomposing the total orbit into $N$ sub-orbits (or simply orbits) related to each of $N$ servers and through comparing the numbers of customers in these orbits, we introduce a retrial supermarket model of $N$ identical servers, where two probing-server choice numbers are respectively designed for dynamically allocating each primary arrival and each retrial arrival into these orbits when the chosen servers are all busy. Note that the designed purpose of the two choice numbers can effectively improve performance measures of this retrial supermarket model. This paper analyzes a simple and basic retrial supermarket model of N identical servers, that is, Poisson arrivals, exponential service and retrial times. To this end, we first provide a detailed probability computation to set up an infinite-dimensional system of differential equations (or mean-field equations) satisfied by the expected fraction vector. Then, as N goes to infinity, we apply the operator semigroup to obtaining the mean-field limit (or chaos of propagation) for the sequence of Markov processes which express the state of this retrial supermarket model. Specifically, some simple and basic conditions for the mean-field limit as well as for the Lipschitz condition are established through the first two moments of the queue length in any orbit. Finally, we show that the fixed point satisfies a system of nonlinear equations which is an interesting networking generalization of the tail equations given in the M/M/1 retrial queue, and also use the fixed point to give performance analysis of this retrial supermarket model through numerical computation.

preprint2014arXiv

Tight finite-key analysis for passive decoy-state quantum key distribution under general attacks

For quantum key distribution (QKD) using spontaneous parametric-down-conversion sources (SPDCSs), the passive decoy-state protocol has been proved to be efficiently close to the theoretical limit of an infinite decoy-state protocol. In this paper, we apply a tight finite-key analysis for the passive decoy-state QKD using SPDCSs. Combining the security bound based on the uncertainty principle with the passive decoy-state protocol, a concise and stringent formula for calculating the key generation rate for QKD using SPDCSs is presented. The simulation shows that the secure distance under our formula can reach up to 182 km when the number of sifted data is $10^{10}$. Our results also indicate that, under the same deviation of statistical fluctuation due to finite-size effects, the passive decoy-state QKD with SPDCSs can perform as well as the active decoy-state QKD with a weak coherent source.

preprint2013arXiv

A hierarchical time-splitting approach for solving finite-time optimal control problems

We present a hierarchical computation approach for solving finite-time optimal control problems using operator splitting methods. The first split is performed over the time index and leads to as many subproblems as the length of the prediction horizon. Each subproblem is solved in parallel and further split into three by separating the objective from the equality and inequality constraints respectively, such that an analytic solution can be achieved for each subproblem. The proposed solution approach leads to a nested decomposition scheme, which is highly parallelizable. We present a numerical comparison with standard state-of-the-art solvers, and provide analytic solutions to several elements of the algorithm, which enhances its applicability in fast large-scale applications.

preprint2013arXiv

A Multiscale Sub-linear Time Fourier Algorithm for Noisy Data

We extend the recent sparse Fourier transform algorithm of (Lawlor, Christlieb, and Wang, 2013) to the noisy setting, in which a signal of bandwidth N is given as a superposition of k << N frequencies and additive noise. We present two such extensions, the second of which exhibits a novel form of error-correction in its frequency estimation not unlike that of the beta-encoders in analog-to-digital conversion (Daubechies et al, 2006). The algorithm runs in time O(k log(k) log(N/k)) on average, provided the noise is not overwhelming. The error-correction property allows the algorithm to outperform FFTW, a highly optimized software package for computing the full discrete Fourier transform, over a wide range of sparsity and noise values, and is to the best of our knowledge novel in the sparse Fourier transform context.

preprint2013arXiv

Bounds of Efficiency at Maximum Power for Normal-, Sub- and Super-Dissipative Carnot-Like Heat Engines

The Carnot-like heat engines are classified into three types (normal-, sub- and super-dissipative) according to relations between the minimum irreversible entropy production in the "isothermal" processes and the time for completing those processes. The efficiencies at maximum power of normal-, sub- and super-dissipative Carnot-like heat engines are proved to be bounded between $η_C/2$ and $η_C/(2-η_C)$, $η_C /2$ and $η_C$, 0 and $η_C/(2-η_C)$, respectively. These bounds are also shared by linear, sub- and super-linear irreversible Carnot-like engines [Tu and Wang, Europhys. Lett. 98, 40001 (2012)] although the dissipative engines and the irreversible ones are inequivalent to each other.

preprint2013arXiv

Global Climate network evolves with North Atlantic Oscillation phases: Coupling to Southern Pacific Ocean

We construct a network from climate records of atmospheric temperature at surface level, at different geographical sites in the globe, using reanalysis data from years 1948-2010. We find that the network correlates with the North Atlantic Oscillation (NAO), both locally in the north Atlantic, and through coupling to the southern Pacific Ocean. The existence of tele-connection links between those areas and their stability over time allows us to suggest a possible physical explanation for this phenomenon.

preprint2013arXiv

Invertibility and Robustness of Phaseless Reconstruction

This paper is concerned with the question of reconstructing a vector in a finite-dimensional real Hilbert space when only the magnitudes of the coefficients of the vector under a redundant linear map are known. We analyze various Lipschitz bounds of the nonlinear analysis map and we establish theoretical performance bounds of any reconstruction algorithm. We show that robust and stable reconstruction requires additional redundancy than the critical threshold.

preprint2013arXiv

Lipschitz Equivalence of Self-Similar Sets: Algebraic and Geometric Properties

In this paper we provide an up-to-date survey on the study of Lipschitz equivalence of self-similar sets. Lipschitz equivalence is an important property in fractal geometry because it preserves many key properties of fractal sets. A fundamental result by Falconer and Marsh [On the Lipschitz equivalence of Cantor sets, \textit{Mathematika}, \textbf{39} (1992), 223--233] establishes conditions for Lipschitz equivalence based on the algebraic properties of the contraction ratios of the self-similar sets. Recently there has been other substantial progress in the field. This paper is a comprehensive survey of the field. It provides a summary of the important and interesting results in the field. In addition we provide detailed discussions on several important techniques that have been used to prove some of the key results. It is our hope that the paper will provide a good overview of major results and techniques, and a friendly entry point for anyone who is interested in studying problems in this field.

preprint2013arXiv

Phase Retrieval for Sparse Signals

The aim of this paper is to build up the theoretical framework for the recovery of sparse signals from the magnitude of the measurement. We first investigate the minimal number of measurements for the success of the recovery of sparse signals without the phase information. We completely settle the minimality question for the real case and give a lower bound for the complex case. We then study the recovery performance of the $\ell_1$ minimization. In particular, we present the null space property which, to our knowledge, is the first sufficient and necessary condition for the success of $\ell_1$ minimization for $k$-sparse phase retrievable.

preprint2013arXiv

Phase retrieval from very few measurements

In many applications, signals are measured according to a linear process, but the phases of these measurements are often unreliable or not available. To reconstruct the signal, one must perform a process known as phase retrieval. This paper focuses on completely determining signals with as few intensity measurements as possible, and on efficient phase retrieval algorithms from such measurements. For the case of complex M-dimensional signals, we construct a measurement ensemble of size 4M-4 which yields injective intensity measurements; this is conjectured to be the smallest such ensemble. For the case of real signals, we devise a theory of "almost" injective intensity measurements, and we characterize such ensembles. Later, we show that phase retrieval from M+1 almost injective intensity measurements is NP-hard, indicating that computationally efficient phase retrieval must come at the price of measurement redundancy.

preprint2013arXiv

Solving the minimum sum coloring problem via binary quadratic programming

In recent years, binary quadratic programming (BQP) has been successively applied to solve several combinatorial optimization problems. We consider in this paper a study of using the BQP model to solve the minimum sum coloring problem (MSCP). For this purpose, we recast the MSCP with a quadratic model which is then solved via a recently proposed Path Relinking (PR) algorithm designed for the general BQP. Based on a set of MSCP benchmark instances, we investigate the performance of this solution approach compared with existing methods.

preprint2013arXiv

The dominant imprint of Rossby waves in the climate network

The connectivity pattern of networks, which are based on a correlation between ground level temperature time series, shows a dominant dense stripe of links in the southern ocean. We show that statistical categorization of these links yields a clear association with the pattern of an atmospheric Rossby wave, one of the major mechanisms associated with the weather system and with planetary scale energy transport. It is shown that alternating densities of negative and positive links (correlations) are arranged in half Rossby wave distances around 3,500 km, 7,000 km and 10,000 km and are aligned with the expected direction of energy flow, distribution of time delays and the seasonality of these waves. It is also shown that long distance links (i.e., of distances larger than 2,000 km) that are associated with Rossby waves are the most dominant in the climate network. Climate networks may thus be used as an efficient new way to detect and analyze Rossby waves, based on reliable and available ground level measurements, in addition to the frequently used 300 hPa reanalysis meridional wind data.

preprint2012arXiv

3D Projection Sideband Cooling

We demonstrate 3D microwave projection sideband cooling of trapped, neutral atoms. The technique employs state-dependent potentials that enable microwave photons to drive vibration-number reducing transitions. The particular cooling sequence we employ uses minimal spontaneous emission, and works even for relatively weakly bound atoms. We cool 76% of atoms to their 3D vibrational ground states in a site-resolvable 3D optical lattice.

preprint2012arXiv

Adaptive Foreground and Shadow Detection inImage Sequences

This paper presents a novel method of foreground segmentation that distinguishes moving objects from their moving cast shadows in monocular image sequences. The models of background, edge information, and shadow are set up and adaptively updated. A Bayesian belief network is proposed to describe the relationships among the segmentation label, background, intensity, and edge information. The notion of Markov random field is used to encourage the spatial connectivity of the segmented regions. The solution is obtained by maximizing the posterior possibility density of the segmentation field.

preprint2012arXiv

Adaptive sub-linear Fourier algorithms

We present a new deterministic algorithm for the sparse Fourier transform problem, in which we seek to identify k << N significant Fourier coefficients from a signal of bandwidth N. Previous deterministic algorithms exhibit quadratic runtime scaling, while our algorithm scales linearly with k in the average case. Underlying our algorithm are a few simple observations relating the Fourier coefficients of time-shifted samples to unshifted samples of the input function. This allows us to detect when aliasing between two or more frequencies has occurred, as well as to determine the value of unaliased frequencies. We show that empirically our algorithm is orders of magnitude faster than competing algorithms.

preprint2012arXiv

An ADMM Algorithm for a Class of Total Variation Regularized Estimation Problems

We present an alternating augmented Lagrangian method for convex optimization problems where the cost function is the sum of two terms, one that is separable in the variable blocks, and a second that is separable in the difference between consecutive variable blocks. Examples of such problems include Fused Lasso estimation, total variation denoising, and multi-period portfolio optimization with transaction costs. In each iteration of our method, the first step involves separately optimizing over each variable block, which can be carried out in parallel. The second step is not separable in the variables, but can be carried out very efficiently. We apply the algorithm to segmentation of data based on changes inmean (l_1 mean filtering) or changes in variance (l_1 variance filtering). In a numerical example, we show that our implementation is around 10000 times faster compared with the generic optimization solver SDPT3.

preprint2012arXiv

Bounds of efficiency at maximum power for linear, superlinear and sublinear irreversible Carnot-like heat engines

The efficiency at maximum power (EMP) of irreversible Carnot-like heat engines is investigated based on the weak endoreversible assumption and the phenomenologically irreversible thermodynamics. It is found that the weak endoreversible assumption can reduce to the conventional one for the heat engines working at maximum power. Carnot-like heat engines are classified into three types (linear, superlinear, and sublinear) according to different characteristics of constitutive relations between the heat transfer rate and the thermodynamic force. The EMPs of Carnot-like heat engines are proved to be bounded between $η_C/2$ and $η_C/(2-η_C)$ for the linear type, 0 and $η_C/(2-η_C)$ for the superlinear type, and $η_C/2$ and $η_C$ for the sublinear type, respectively, where $η_C$ is the Carnot efficiency.

preprint2012arXiv

Coefficient of performance at maximum figure of merit and its bounds for low-dissipation Carnot-like refrigerators

The figure of merit for refrigerators performing finite-time Carnot-like cycles between two reservoirs at temperature $T_h$ and $T_c$ ($<T_h$) is optimized. It is found that the coefficient of performance at maximum figure of merit is bounded between 0 and $(\sqrt{9+8\varepsilon_c}-3)/2$ for the low-dissipation refrigerators, where $\varepsilon_c =T_c/(T_h-T_c)$ is the Carnot coefficient of performance for reversible refrigerators. These bounds can be reached for extremely asymmetric low-dissipation cases when the ratio between the dissipation constants of the processes in contact with the cold and hot reservoirs approaches to zero or infinity, respectively. The observed coefficients of performance for real refrigerators are located in the region between the lower and upper bounds, which is in good agreement with our theoretical estimation.

preprint2012arXiv

Lipschitz equivalence of self-similar sets with touching structures

Lipschitz equivalence of self-similar sets is an important area in the study of fractal geometry. It is known that two dust-like self-similar sets with the same contraction ratios are always Lipschitz equivalent. However, when self-similar sets have touching structures the problem of Lipschitz equivalence becomes much more challenging and intriguing at the same time. So far the only known results only cover self-similar sets in $\bR$ with no more than 3 branches. In this study we establish results for the Lipschitz equivalence of self-similar sets with touching structures in $\bR$ with arbitrarily many branches. Key to our study is the introduction of a geometric condition for self-similar sets called {\em substitutable}.

preprint2012arXiv

Mapping Dirac Quasiparticles near a Single Coulomb Impurity on Graphene

The response of Dirac fermions to a Coulomb potential is predicted to differ significantly from the behavior of non-relativistic electrons seen in traditional atomic and impurity systems. Surprisingly, many key theoretical predictions for this ultra-relativistic regime have yet to be tested in a laboratory. Graphene, a 2D material in which electrons behave like massless Dirac fermions, provides a unique opportunity to experimentally test such predictions. The response of Dirac fermions to a Coulomb potential in graphene is central to a wide range of electronic phenomena and can serve as a sensitive probe of graphene's intrinsic dielectric constant, the primary factor determining the strength of electron-electron interactions in this material. Here we present a direct measurement of the nanoscale response of Dirac fermions to a single Coulomb potential placed on a gated graphene device. Scanning tunneling microscopy and spectroscopy were used to fabricate tunable charge impurities on graphene and to measure how they are screened by Dirac fermions for a Q = +1|e| impurity charge state. Electron-like and hole-like Dirac fermions were observed to respond very differently to tunable Coulomb potentials. Comparison of this electron-hole asymmetry to theoretical simulations has allowed us to test basic predictions for the behavior of Dirac fermions near a Coulomb potential and to extract the intrinsic dielectric constant of graphene: ε_g= 3.0 \pm 1.0. This small value of ε_g indicates that microscopic electron-electron interactions can contribute significantly to graphene properties.

preprint2012arXiv

Near-infrared interferometric observation of the Herbig Ae star HD144432 with VLTI/AMBER

We study the sub-AU-scale circumstellar environment of the Herbig Ae star HD144432 with near-infrared (NIR) VLTI/AMBER observations to investigate the structure of its inner dust disk. The interferometric observations were carried out with the AMBER instrument in the H and K band. We interpret the measured H- and K-band visibilities, the near- and mid-infrared visibilities from the literature, and the SED of HD144432 by using geometric ring models and ring-shaped temperature-gradient disk models with power-law temperature distributions. We derived a K-band ring-fit radius of 0.17 \pm 0.01 AU and an H-band radius of 0.18 \pm 0.01 AU (for a distance of 145 pc). This measured K-band radius of \sim0.17 AU lies in the range between the dust sublimation radius of \sim0.13 AU (predicted for a dust sublimation temperature of 1500 K and gray dust) and the prediction of models including backwarming (\sim0.27 AU). We found that an additional extended halo component is required in both the geometric and temperature-gradient modeling. In the best temperature- gradient model, the disk consists of two components. The inner part of the disk is a thin ring with an inner radius of \sim0.21 AU, a temperature of \sim1600 K, and a ring thickness \sim0.02 AU. The outer part extends from \sim1 AU to \sim10 AU with an inner temperature of \sim400 K. We find that the disk is nearly face-on with an inclination angle of < 28 degree. Our temperature-gradient modeling suggests that the NIR excess is dominated by emission from a narrow, bright rim located at the dust sublimation radius, while an extended halo component contributes \sim6% to the total flux at 2 μm. The MIR model emission has a two-component structure with \sim20% flux from the inner ring and the rest from the outer part. This two-component structure suggests a disk gap, which is possibly caused by the shadow of a puffed-up inner rim.

preprint2012arXiv

Necessary and sufficient conditions to perform Spectral Tetris

Spectral Tetris has proved to be a powerful tool for constructing sparse equal norm Hilbert space frames. We introduce a new form of Spectral Tetris which works for non-equal norm frames. It is known that this method cannot construct all frames --- even in the new case introduced here. Until now, it has been a mystery as to why Spectral Tetris sometimes works and sometimes fails. We will give a complete answer to this mystery by giving necessary and sufficient conditions for Spectral Tetris to construct frames in all cases including equal norm frames, prescribed norm frames, frames with constant spectrum of the frame operator, and frames with prescribed spectrum for the frame operator. We present a variety of examples as well as special cases where Spectral Tetris always works.

preprint2012arXiv

Oxygen-vacancy-related relaxation and scaling behaviors of Bi0.9La0.1Fe0.98Mg0.02O3 (La,Mg-codoped BiFeO3) ferroelectric thin film

Oxygen-vacancies-related dielectric relaxation and scaling behaviors of Bi0.9La0.1Fe0.98Mg0.02O3 (BLFM) thin film have been investigated by temperature-dependent impedance spectroscopy from 40 oC up to 200 oC. We found that hopping electrons and single-charged oxygen vacancies (VO.) coexist in the BLFM thin film and make contribution to dielectric response of grain and grain boundary respectively. The activation energy for VO. is shown to be 0.94 eV in the whole temperature range investigated, whereas the distinct activation energies for electrons are 0.136 eV below 110oC and 0.239 eV above 110oC in association with hopping along the Fe2+- VO.-Fe3+ chain and hopping between Fe2+-Fe3+, respectively, indicating different hopping processes for electrons. Moreover, it has been found that hopping electrons is in form of long rang movement, while localized and long range movement of oxygen vacancies coexist in BLFM film. The Cole-Cole plots in modulus formalism show a poly-dispersive nature of relaxation for oxygen vacancies and a unique relaxation time for hopping electrons. The scaling behavior of modulus spectra further suggests that the distribution of relaxation times for oxygen vacancies is temperature independent.

preprint2012arXiv

Spectral coarse graining for random walk in bipartite networks

Many real-world networks display a natural bipartite structure, while analyzing or visualizing large bipartite networks is one of the most challenges. As a result, it is necessary to reduce the complexity of large bipartite systems and preserve the functionality at the same time. We observe, however, the existing coarse graining methods for binary networks fail to work in the bipartite networks. In this paper, we use the spectral analysis to design a coarse graining scheme specifically for bipartite networks and keep their random walk properties unchanged. Numerical analysis on artificial and real-world bipartite networks indicates that our coarse graining scheme could obtain much smaller networks from large ones, keeping most of the relevant spectral properties. Finally, we further validate the coarse graining method by directly comparing the mean first passage time between the original network and the reduced one.

preprint2012arXiv

Spectral Tetris Fusion Frame Constructions

Spectral tetris is a fexible and elementary method to construct unit norm frames with a given frame operator, having all of its eigenvalues greater than or equal to two. One important application of spectral tetris is the construction of fusion frames. We first show how the assumption on the spectrum of the frame operator can be dropped and extend the spectral tetris algorithm to construct unit norm frames with any given spectrum of the frame operator. We then provide a suffcient condition for using this generalization of spectral tetris to construct fusion frames with prescribed spectrum for the fusion frame operator and with prescribed dimensions for the subspaces. This condition is shown to be necessary in the tight case of redundancy greater than two.

preprint2011arXiv

A Matrix-Analytic Solution for Randomized Load Balancing Models with Phase-Type Service Times

In this paper, we provide a matrix-analytic solution for randomized load balancing models (also known as \emph{supermarket models}) with phase-type (PH) service times. Generalizing the service times to the phase-type distribution makes the analysis of the supermarket models more difficult and challenging than that of the exponential service time case which has been extensively discussed in the literature. We first describe the supermarket model as a system of differential vector equations, and provide a doubly exponential solution to the fixed point of the system of differential vector equations. Then we analyze the exponential convergence of the current location of the supermarket model to its fixed point. Finally, we present numerical examples to illustrate our approach and show its effectiveness in analyzing the randomized load balancing schemes with non-exponential service requirements.

preprint2011arXiv

Detecting Important Nodes to Community Structure Using the Spectrum of the Graph

Many complex systems can be represented as networks, and how a network breaks up into subnetworks or communities is of wide interest. However, the development of a method to detect nodes important to communities that is both fast and accurate is a very challenging and open problem. In this manuscript, we introduce a new approach to characterize the node importance to communities. First, a centrality metric is proposed to measure the importance of network nodes to community structure using the spectrum of the adjacency matrix. We define the node importance to communities as the relative change in the eigenvalues of the network adjacency matrix upon their removal. Second, we also propose an index to distinguish two kinds of important nodes in communities, i.e., "community core" and "bridge". Our indices are only relied on the spectrum of the graph matrix. They are applied in many artificial networks as well as many real-world networks. This new methodology gives us a basic approach to solve this challenging problem and provides a realistic result.

preprint2011arXiv

Efficiency at maximum power output of linear irreversible Carnot-like heat engines

The efficiency at maximum power output of linear irreversible Carnot-like heat engines is investigated based on the assumption that the rate of irreversible entropy production of working substance in each "isothermal" process is a quadratic form of heat exchange rate between the working substance and the reservoir. It is found that the maximum power output corresponds to minimizing the irreversible entropy production in two "isothermal" processes of the Carnot-like cycle, and that the efficiency at maximum power output has the form as $η_{mP}={η_C}/(2-γη_C)$ where $η_C$ is the Carnot efficiency while $γ$ depends on the heat transfer coefficients between the working substance and two reservoirs. The value of $η_{mP}$ is bounded between $η_{-}\equiv η_C/2$ and $η_{+}\equivη_C/(2-η_C)$. These results are consistent with those obtained by Chen and Yan [J. Chem. Phys. \textbf{90}, 3740 (1989)] based on the endoreversible assumption, those obtained by Esposito \textit{et al.} [Phys. Rev. Lett. \textbf{105}, 150603 (2010)] based on the low-dissipation assumption, and those obtained by Schmiedl and Seifert [EPL \textbf{81}, 20003 (2008)] for stochastic heat engines which in fact also satisfy the low-dissipation assumption. Additionally, we find that the endoreversible assumption happens to hold for Carnot-like heat engines operating at the maximum power output based on our fundamental assumption, and that the Carnot-like heat engines that we focused does not strictly satisfy the low-dissipation assumption, which implies that the low-dissipation assumption or our fundamental assumption is a sufficient but non-necessary condition for the validity of $η_{mP}={η_C}/(2-γη_C)$ as well as the existence of two bounds $η_{-}\equiv η_C/2$ and $η_{+}\equivη_C/(2-η_C)$.

preprint2011arXiv

Evidence of Photocatalytic Dissociation of Water on TiO2 with Atomic Resolution

Photocatalytic water splitting reaction on TiO2 surface is one of the fundamental issues that bears significant implication in hydrogen energy technology and has been extensively studied. However, the existence of the very first reaction step, the direct photo-dissociation of water, has been disregarded. Here, we provide unambiguously experimental evidence to demonstrate that adsorbed water molecules on reduced rutile TiO2(110)-1\times1 surface can be dissociated under UV irradiation using low temperature scanning tunneling microscopy. It is identified that a water molecule at fivefold coordinated Ti (Ti5c) site can be photocatalytically dissociated, resulting in a hydroxyl at Ti5c and another hydroxyl at bridge oxygen row. Our findings reveal a missing link in the photocatalytic water splitting reaction chain, which greatly contribute to the detailed understanding of underlying mechanism.

preprint2011arXiv

Fabrication of hydrophobic inorganic coatings on natural lotus leaves for nanoimprint stamps

Hydrophobic inorganic films were obtained by direct deposition of copper or silicon onto natural lotus leaves by ion beam sputtering deposition technique. Scanning electron microscopy observations showed a lotus-leaf-like surface structure of the deposited inorganic films. Hydrophobic nature of the inorganic films on lotus leaves had been improved compared to the inorganic films deposited on flat silicon substrates. Water contact angles measured on the lotus-leaf-like copper and silicon films were 136.3 \pm 8° and 117.8 \pm 4.4°, respectively. The hydrophobic lotus-leaf-like inorganic films had been repeated used as nanoimprint stamps. Negative structures of lotus-leaf-like inorganic films were obtained on the polystyrene resist layers.

preprint2011arXiv

Fabrication of surface-patterned ZnO thin films using sol-gel methods and nanoimprint lithography

Surface-patterned ZnO thin films were fabricated by direct imprinting on ZnO sol and subsequent annealing process. The polymer-based ZnO sols were deposited on various substrates for the nanoimprint lithography and converted to surface-patterned ZnO gel films during the thermal curing nanoimprint process. Finally, crystalline ZnO films were obtained by subsequent annealing of the patterned ZnO gel films. The optical characterization indicates that the surface patterning of ZnO thin films can lead to an enhanced transmittance. Large-scale ZnO thin films with different patterns can be fabricated by various easy-made ordered templates using this combination of sol-gel and nanoimprint lithography techniques.

preprint2011arXiv

Femtosecond Laser-induced Crystallization of Amorphous Sb2Te3 film and Coherent Phonon Spectroscopy Characterization and Optical Injection of Electron Spins

A femtosecond laser-irradiated crystallizing technique is tried to convert amorphous Sb2Te3 film into crystalline film. Sensitive coherent phonon spectroscopy (CPS) is used to monitor the crystallization of amorphous Sb2Te3 film at the original irradiation site. The CPS reveals that the vibration strength of two phonon modes that correspond to the characteristic phonon modes of crystalline Sb2Te3, enhances with increasing laser irradiation fluence (LIF), showing the rise of the degree of crystallization with LIF and that femtosecond laser irradiation is a good post-treatment technique. Time-resolved circularly polarized pump-probe spectroscopy is used to investigate electron spin relaxation dynamics of the laser-induced crystallized Sb2Te3 film. Spin relaxation process indeed is observed, confirming the theoretical predictions on the validity of spin-dependent optical transition selection rule and the feasibility of transient spin-grating-based optical detection scheme of spin-plasmon collective modes in Sb2Te3-like topological insulators.

preprint2011arXiv

The Entrainment-Limited Evolution of FR II Sources: Maximum Sizes and A Possible Connection to FR Is

We construct a simple theoretical model to investigate how entrainment gradually erodes high-speed FR II jets. This process is described by embedding a mixing-layer model developed originally to describe FR I objects in a self-similar model for the lobe structure of classical FR II sources. Following the classical FR II models, we assume that the lobe is dominated by the particles injected from the central jet. The entrainment produces a boundary shear layer which acts at the interface between the dense central jet and the less denser surrounding lobe, and the associated erosion of the jet places interesting limits on the maximum size of FR II sources. The model shows that this limit depends mainly on the initial bulk velocity of the relativistic jet triggered. The bulk velocities of FR IIs suggested by our model are in good agreement with that obtained from direct pc-scale observations on ordinary radio galaxies and quasars. Finally, we discuss how FR IIs may evolve into FR Is upon reaching their maximum, entrainment-limited sizes.

preprint2011arXiv

The Performance of PCM Quantization Under Tight Frame Representations

In this paper, we study the performance of the PCM scheme with linear quantization rule for quantizing finite unit-norm tight frame expansions for $\R^d$ and derive the PCM quantization error without the White Noise Hypothesis. We prove that for the class of unit norm tight frames derived from uniform frame paths the quantization error has an upper bound of $O(δ^{3/2})$ regardless of the frame redundancy. This is achieved using some of the techniques developed by Güntürk in his study of Sigma-Delta quantization. Using tools of harmonic analysis we show that this upper bound is sharp for $d=2$. A consequence of this result is that, unlike with Sigma-Delta quantization, the error for PCM quantization in general does not diminish to zero as one increases the frame redundancy. We extend the result to high dimension and show that the PCM quantization error has an upper bound $O(δ^{(d+1)/2})$ for asymptopitcally equidistributed unit-norm tight frame of $\R^{d}$.

preprint2011arXiv

The Regularity of Refinable Functions

The regularity of refinable functions has been studied extensively in the past. A classical result by Daubechies and Lagarias states that a compactly supported refinable function in $\R$ of finite mask with integer dilation and translations cannot be in $C^\infty$. A bound on the regularity based on the eigenvalues of certain matrices associated with the refinement equation is also given. Surprisingly this fundamental classical result has not been proved in the more general settings, such as in higher dimensions or when the dilation is not an integer. In this paper we extend this classical result to the most general setting for arbitrary dimension, dilation and translations.

preprint2010arXiv

A geometric construction of tight Gabor frames with multivariate compactly supported smooth windows

The geometry of fundamental domains of lattices was used by Han and Wang to construct multivariate Gabor frames for separable lattices. We build upon their results to obtain Gabor frames with smooth and compactly supported window functions. For this purpose we study pairs of lattices which have equal density and allow for a common compact and star-shaped fundamental domain. The results are then extended to a larger class of lattices via symplectic equivalence.

preprint2010arXiv

Detecting Image Forgeries using Geometric Cues

This chapter presents a framework for detecting fake regions by using various methods including watermarking technique and blind approaches. In particular, we describe current categories on blind approaches which can be divided into five: pixel-based techniques, format-based techniques, camera-based techniques, physically-based techniques and geometric-based techniques. Then we take a second look on the geometric-based techniques and further categorize them in detail. In the following section, the state-of-the-art methods involved in the geometric technique are elaborated.

preprint2010arXiv

Element Retrieval using Namespace Based on keyword search over XML Documents

Querying over XML elements using keyword search is steadily gaining popularity. The traditional similarity measure is widely employed in order to effectively retrieve various XML documents. A number of authors have already proposed different similarity-measure methods that take advantage of the structure and content of XML documents. They do not, however, consider the similarity between latent semantic information of element texts and that of keywords in a query. Although many algorithms on XML element search are available, some of them have the high computational complexity due to searching a huge number of elements. In this paper, we propose a new algorithm that makes use of the semantic similarity between elements instead of between entire XML documents, considering not only the structure and content of an XML document, but also semantic information of namespaces in elements. We compare our algorithm with the three other algorithms by testing on the real datasets. The experiments have demonstrated that our proposed method is able to improve the query accuracy, as well as to reduce the running time.

preprint2010arXiv

Enhanced diffusion due to active swimmers at a solid surface

We consider two systems of active swimmers moving close to a solid surface, one being a living population of wild-type \textit{E. coli} and the other being an assembly of self-propelled Au-Pt rods. In both situations, we have identified two different types of motion at the surface and evaluated the fraction of the population that displayed ballistic trajectories (active swimmers) with respect to those showing random-like behavior. We studied the effect of this complex swimming activity on the diffusivity of passive tracers also present at the surface. We found that the tracer diffusivity is enhanced with respect to standard Brownian motion and increases linearly with the activity of the fluid, defined as the product of the fraction of active swimmers and their mean velocity. This result can be understood in terms of series of elementary encounters between the active swimmers and the tracers.

preprint2010arXiv

Gate-Controlled Ionization and Screening of Cobalt Adatoms on a Graphene Surface

We describe scanning tunneling spectroscopy (STS) measurements performed on individual cobalt (Co) atoms deposited onto backgated graphene devices. We find that Co adatoms on graphene can be ionized by either the application of a global backgate voltage or by the application of a local electric field from a scanning tunneling microscope (STM) tip. Large screening clouds are observed to form around Co adatoms ionized in this way, and we observe that some intrinsic graphene defects display a similar behavior. Our results provide new insight into charged impurity scattering in graphene, as well as the possibility of using graphene devices as chemical sensors.

preprint2009arXiv

Fragmentation at the Earliest Phase of Massive Star Formation

We present 1.3mm continuum and spectral line images of two massive molecular clumps P1 and P2 in the G28.34+0.06 region with the Submillimeter Array. While the two clumps contain masses of 1000 and 880 \msun, respectively, P1 has a luminosity $< 10^2$ \lsun, and a lower gas temperature and smaller line width than P2. Thus, P1 appears to be at a much earlier stage of massive star formation than P2. The high resolution SMA observations reveal two distinctive cores in P2 with masses of 97 and 49 \msun, respectively. The 4 GHz spectral bandpass captures line emission from CO isotopologues, SO, CH$_3$OH, and CH$_3$CN, similar to hot molecular cores harboring massive young stars. The P1 clump, on the other hand, is resolved into five cores along the filament with masses from 22 to 64 \msun and an average projected separation of 0.19 pc. Except $^{12}$CO, no molecular line emission is detected toward the P1 cores at a 1$σ$ rms of 0.1 K. Since strong $^{12}$CO and C$^{18}$O emissions are seen with the single dish telescope at a resolution of 11$''$, the non-detection of these lines with the SMA indicates a depletion factor upto $10^3$. While the spatial resolution of the SMA is better than the expected Jeans length, the masses in P1 cores are much larger than the thermal Jeans mass, indicating the importance of turbulence and/or magnetic fields in cloud fragmentation. The hierarchical structures in the P1 region provide a glimpse of the initial phase of massive star and cluster formation.