Source author record

Fei Yang

Fei Yang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

29works
15topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

29 published item(s)

preprint2022arXiv

A Novel Framework for Image-to-image Translation and Image Compression

Data-driven paradigms using machine learning are becoming ubiquitous in image processing and communications. In particular, image-to-image (I2I) translation is a generic and widely used approach to image processing problems, such as image synthesis, style transfer, and image restoration. At the same time, neural image compression has emerged as a data-driven alternative to traditional coding approaches in visual communications. In this paper, we study the combination of these two paradigms into a joint I2I compression and translation framework, focusing on multi-domain image synthesis. We first propose distributed I2I translation by integrating quantization and entropy coding into an I2I translation framework (i.e. I2Icodec). In practice, the image compression functionality (i.e. autoencoding) is also desirable, requiring to deploy alongside I2Icodec a regular image codec. Thus, we further propose a unified framework that allows both translation and autoencoding capabilities in a single codec. Adaptive residual blocks conditioned on the translation/compression mode provide flexible adaptation to the desired functionality. The experiments show promising results in both I2I translation and image compression using a single model.

preprint2022arXiv

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

In this paper, we take the advantage of previous pre-trained models (PTMs) and propose a novel Chinese Pre-trained Unbalanced Transformer (CPT). Different from previous Chinese PTMs, CPT is designed to utilize the shared knowledge between natural language understanding (NLU) and natural language generation (NLG) to boost the performance. CPT consists of three parts: a shared encoder, an understanding decoder, and a generation decoder. Two specific decoders with a shared encoder are pre-trained with masked language modeling (MLM) and denoising auto-encoding (DAE) tasks, respectively. With the partially shared architecture and multi-task pre-training, CPT can (1) learn specific knowledge of both NLU or NLG tasks with two decoders and (2) be fine-tuned flexibly that fully exploits the potential of the model. Moreover, the unbalanced Transformer saves the computational and storage cost, which makes CPT competitive and greatly accelerates the inference of text generation. Experimental results on a wide range of Chinese NLU and NLG tasks show the effectiveness of CPT.

preprint2022arXiv

Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling

Domain adaptation (DA) aims to transfer knowledge learned from a labeled source domain to an unlabeled or a less labeled but related target domain. Ideally, the source and target distributions should be aligned to each other equally to achieve unbiased knowledge transfer. However, due to the significant imbalance between the amount of annotated data in the source and target domains, usually only the target distribution is aligned to the source domain, leading to adapting unnecessary source specific knowledge to the target domain, i.e., biased domain adaptation. To resolve this problem, in this work, we delve into the transferability estimation problem in domain adaptation and propose a non-intrusive Unbiased Transferability Estimation Plug-in (UTEP) by modeling the uncertainty of a discriminator in adversarial-based DA methods to optimize unbiased transfer. We theoretically analyze the effectiveness of the proposed approach to unbiased transferability learning in DA. Furthermore, to alleviate the impact of imbalanced annotated data, we utilize the estimated uncertainty for pseudo label selection of unlabeled samples in the target domain, which helps achieve better marginal and conditional distribution alignments between domains. Extensive experimental results on a high variety of DA benchmark datasets show that the proposed approach can be readily incorporated into various adversarial-based DA methods, achieving state-of-the-art performance.

preprint2022arXiv

OneFlow: Redesign the Distributed Deep Learning Framework from Scratch

Deep learning frameworks such as TensorFlow and PyTorch provide a productive interface for expressing and training a deep neural network (DNN) model on a single device or using data parallelism. Still, they may not be flexible or efficient enough in training emerging large models on distributed devices, which require more sophisticated parallelism beyond data parallelism. Plugins or wrappers have been developed to strengthen these frameworks for model or pipeline parallelism, but they complicate the usage and implementation of distributed deep learning. Aiming at a simple, neat redesign of distributed deep learning frameworks for various parallelism paradigms, we present OneFlow, a novel distributed training framework based on an SBP (split, broadcast and partial-value) abstraction and the actor model. SBP enables much easier programming of data parallelism and model parallelism than existing frameworks, and the actor model provides a succinct runtime mechanism to manage the complex dependencies imposed by resource constraints, data movement and computation in distributed deep learning. We demonstrate the general applicability and efficiency of OneFlow for training various large DNN models with case studies and extensive experiments. The results show that OneFlow outperforms many well-known customized libraries built on top of the state-of-the-art frameworks. The code of OneFlow is available at: https://github.com/Oneflow-Inc/oneflow.

preprint2022arXiv

Slimmable Compressive Autoencoders for Practical Neural Image Compression

Neural image compression leverages deep neural networks to outperform traditional image codecs in rate-distortion performance. However, the resulting models are also heavy, computationally demanding and generally optimized for a single rate, limiting their practical use. Focusing on practical image compression, we propose slimmable compressive autoencoders (SlimCAEs), where rate (R) and distortion (D) are jointly optimized for different capacities. Once trained, encoders and decoders can be executed at different capacities, leading to different rates and complexities. We show that a successful implementation of SlimCAEs requires suitable capacity-specific RD tradeoffs. Our experiments show that SlimCAEs are highly flexible models that provide excellent rate-distortion performance, variable rate, and dynamic adjustment of memory, computational cost and latency, thus addressing the main requirements of practical image compression.

preprint2022arXiv

Slimmable Video Codec

Neural video compression has emerged as a novel paradigm combining trainable multilayer neural networks and machine learning, achieving competitive rate-distortion (RD) performances, but still remaining impractical due to heavy neural architectures, with large memory and computational demands. In addition, models are usually optimized for a single RD tradeoff. Recent slimmable image codecs can dynamically adjust their model capacity to gracefully reduce the memory and computation requirements, without harming RD performance. In this paper we propose a slimmable video codec (SlimVC), by integrating a slimmable temporal entropy model in a slimmable autoencoder. Despite a significantly more complex architecture, we show that slimming remains a powerful mechanism to control rate, memory footprint, computational cost and latency, all being important requirements for practical video compression.

preprint2022arXiv

Towards Unified Prompt Tuning for Few-shot Text Classification

Prompt-based fine-tuning has boosted the performance of Pre-trained Language Models (PLMs) on few-shot text classification by employing task-specific prompts. Yet, PLMs are unfamiliar with prompt-style expressions during pre-training, which limits the few-shot learning performance on downstream tasks. It would be desirable if the models can acquire some prompting knowledge before adaptation to specific NLP tasks. We present the Unified Prompt Tuning (UPT) framework, leading to better few-shot text classification for BERT-style models by explicitly capturing prompting semantics from non-target NLP datasets. In UPT, a novel paradigm Prompt-Options-Verbalizer is proposed for joint prompt learning across different NLP tasks, forcing PLMs to capture task-invariant prompting knowledge. We further design a self-supervised task named Knowledge-enhanced Selective Masked Language Modeling to improve the PLM's generalization abilities for accurate adaptation to previously unseen tasks. After multi-task learning across multiple tasks, the PLM can be better prompt-tuned towards any dissimilar target tasks in low-resourced settings. Experiments over a variety of NLP tasks show that UPT consistently outperforms state-of-the-arts for prompt-based fine-tuning.

preprint2021arXiv

Quasisymmetric uniformization and Hausdorff dimensions of Cantor circle Julia sets

For Cantor circle Julia sets of hyperbolic rational maps, we prove that they are quasisymmetrically equivalent to standard Cantor circles (i.e., connected components are round circles). This gives a quasisymmetric uniformization of all Cantor circle Julia sets of hyperbolic rational maps. By analyzing the combinatorial information of the rational maps whose Julia sets are Cantor circles, we give a computational formula of the number of the Cantor circle hyperbolic components in the moduli space of rational maps for any fixed degree. We calculate the Hausdorff dimensions of the Julia sets which are Cantor circles, and prove that for any Cantor circle hyperbolic component $\mathcal{H}$ in the space of rational maps, the infimum of the Hausdorff dimensions of the Julia sets of the maps in $\mathcal{H}$ is equal to the conformal dimension of the Julia set of any representative $f_0\in\mathcal{H}$, and that the supremum of the Hausdorff dimensions is equal to $2$.

preprint2020arXiv

Dimension paradox of irrationally indifferent attractors

In this paper we study the geometry of the attractors of holomorphic maps with an irrationally indifferent fixed point. We prove that for an open set of such holomorphic systems, the local attractor at the fixed point has Hausdorff dimension two, provided the asymptotic rotation at the fixed point is of sufficiently high type and does not belong to Herman numbers. As an immediate corollary, the Hausdorff dimension of the Julia set of any such rational map with a Cremer fixed point is equal to two. Moreover, we show that for a class of asymptotic rotation numbers, the attractor satisfies Karpińska's dimension paradox. That is, the the set of end points of the attractor has dimension two, but without those end points, the dimension drops to one.

preprint2020arXiv

Julia sets as buried Julia components

Let $f$ be a rational map with degree $d\geq 2$ whose Julia set is connected but not equal to the whole Riemann sphere. It is proved that there exists a rational map $g$ such that $g$ contains a buried Julia component on which the dynamics is quasiconformally conjugate to that of $f$ on the Julia set if and only if $f$ does not have parabolic basins and Siegel disks. If such $g$ exists, then the degree can be chosen such that $\text{deg}(g)\leq 7d-2$. In particular, if $f$ is a polynomial, then $g$ can be chosen such that $\text{deg}(g)\leq 4d+4$. Moreover, some quartic and cubic rational maps whose Julia sets contain buried Jordan curves are also constructed.

preprint2020arXiv

Self-Training for Domain Adaptive Scene Text Detection

Though deep learning based scene text detection has achieved great progress, well-trained detectors suffer from severe performance degradation for different domains. In general, a tremendous amount of data is indispensable to train the detector in the target domain. However, data collection and annotation are expensive and time-consuming. To address this problem, we propose a self-training framework to automatically mine hard examples with pseudo-labels from unannotated videos or images. To reduce the noise of hard examples, a novel text mining module is implemented based on the fusion of detection and tracking results. Then, an image-to-video generation method is designed for the tasks that videos are unavailable and only images can be used. Experimental results on standard benchmarks, including ICDAR2015, MSRA-TD500, ICDAR2017 MLT, demonstrate the effectiveness of our self-training method. The simple Mask R-CNN adapted with self-training and fine-tuned on real data can achieve comparable or even superior results with the state-of-the-art methods.

preprint2020arXiv

Two-Level Residual Distillation based Triple Network for Incremental Object Detection

Modern object detection methods based on convolutional neural network suffer from severe catastrophic forgetting in learning new classes without original data. Due to time consumption, storage burden and privacy of old data, it is inadvisable to train the model from scratch with both old and new data when new object classes emerge after the model trained. In this paper, we propose a novel incremental object detector based on Faster R-CNN to continuously learn from new object classes without using old data. It is a triple network where an old model and a residual model as assistants for helping the incremental model learning on new classes without forgetting the previous learned knowledge. To better maintain the discrimination of features between old and new classes, the residual model is jointly trained on new classes in the incremental learning procedure. In addition, a corresponding distillation scheme is designed to guide the training process, which consists of a two-level residual distillation loss and a joint classification distillation loss. Extensive experiments on VOC2007 and COCO are conducted, and the results demonstrate that the proposed method can effectively learn to incrementally detect objects of new classes, and the problem of catastrophic forgetting is mitigated in this context.

preprint2020arXiv

Variable Rate Deep Image Compression with Modulated Autoencoder

Variable rate is a requirement for flexible and adaptable image and video compression. However, deep image compression methods are optimized for a single fixed rate-distortion tradeoff. While this can be addressed by training multiple models for different tradeoffs, the memory requirements increase proportionally to the number of models. Scaling the bottleneck representation of a shared autoencoder can provide variable rate compression with a single shared autoencoder. However, the R-D performance using this simple mechanism degrades in low bitrates, and also shrinks the effective range of bit rates. Addressing these limitations, we formulate the problem of variable rate-distortion optimization for deep image compression, and propose modulated autoencoders (MAEs), where the representations of a shared autoencoder are adapted to the specific rate-distortion tradeoff via a modulation network. Jointly training this modulated autoencoder and modulation network provides an effective way to navigate the R-D operational curve. Our experiments show that the proposed method can achieve almost the same R-D performance of independent models with significantly fewer parameters.

preprint2019arXiv

Fiber-optic joint time and frequency transfer with the same wavelength

Optical fiber links have demonstrated their ability to transfer the ultra-stable clock signals. In this paper we propose and demonstrate a new scheme to transfer both time and radio frequency with the same wavelength based on coherent demodulation technique. Time signal is encoded as a binary phase-shift keying (BPSK) to the optical carrier using electro optic modulator (EOM) by phase modulation and makes sure the frequency signal free from interference with single pulse. The phase changes caused by the fluctuations of the transfer links are actively cancelled at local site by optical delay lines. Radio frequency with 1GHz and time signal with one pulse per second (1PPS) transmitted over a 110km fiber spools are obtained. The experimental results demonstrate that frequency instabilities of 1.7E-14 at 1s and 5.9E-17 at 104s. Moreover, time interval transfer of 1PPS signal reaches sub-ps stability after 1000s. This scheme offers advantages with respect to reduce the channel in fiber network, and can keep time and frequency signal independent of each other.

preprint2016arXiv

On the Executability of Interactive Computation

The model of interactive Turing machines (ITMs) has been proposed to characterise which stream translations are interactively computable; the model of reactive Turing machines (RTMs) has been proposed to characterise which behaviours are reactively executable. In this article we provide a comparison of the two models. We show, on the one hand, that the behaviour exhibited by ITMs is reactively executable, and, on the other hand, that the stream translations naturally associated with RTMs are interactively computable. We conclude from these results that the theory of reactive executability subsumes the theory of interactive computability. Inspired by the existing model of ITMs with advice, which provides a model of evolving computation, we also consider RTMs with advice and we establish that a facility of advice considerably upgrades the behavioural expressiveness of RTMs: every countable transition system can be simulated by some RTM with advice up to a fine notion of behavioural equivalence.

preprint2016arXiv

Rational maps without Herman rings

Let $f$ be a rational map with degree at least two. We prove that $f$ has at least $2$ disjoint and infinite critical orbits in the Julia set if it has a Herman ring. This result is sharp in the following sense: there exists a cubic rational map having exactly two critical grand orbits but also having a Herman ring. In particular, $f$ has no Herman rings if it has at most one infinite critical orbit in the Julia set. These criterions derive some known results about the rational maps without Herman rings.

preprint2016arXiv

Singular perturbations with multiple poles of the simple polynomials

In this article, we study the dynamics of the following family of rational maps with one parameter: \begin{equation*} f_λ(z)= z^n+\frac{λ^2}{z^n-λ}, \end{equation*} where $n\geq 3$ and $λ\in\mathbb{C}^*$. This family of rational maps can be viewed as a singular perturbations of the simple polynomial $P_n(z)=z^n$. We give a characterization of the topological properties of the Julia sets of the family $f_λ$ according to the dynamical behaviors of the orbits of the free critical points.

preprint2016arXiv

Time and Frequency Injection into a Stabilized Fiber Link for Multi-clock Dissemination Network

Owing to the characteristics of ultra-low loss and anti-electromagnetic interference, using optical fiber to deliver time and frequency signal has been a preferred choice for high precise clock dissemination and comparison. As a brilliant idea, one has been able to reproduce ultra-stable signals from one local station to multiple users. In this paper, we take a step further. A concept of multi-clock (in different locations) dissemination for multi-terminals is presented. By injecting frequency signals into one stabilized ring-like fiber network, the relative stabilities of 3.4e-14@1s for a master clock dissemination and 5.1e-14@1s for a slave clock dissemination have been achieved. The proposed scheme can greatly simplify the future 'N' to 'N' time and frequency dissemination network, especially facing a multi-clock comparison situation.

preprint2015arXiv

Executable Behaviour and the π-Calculus (extended abstract)

Reactive Turing machines extend classical Turing machines with a facility to model observable interactive behaviour. We call a behaviour executable if, and only if, it is behaviourally equivalent to the behaviour of a reactive Turing machine. In this paper, we study the relationship between executable behaviour and behaviour that can be specified in the pi-calculus. We establish that all executable behaviour can be specified in the pi-calculus up to divergence-preserving branching bisimilarity. The converse, however, is not true due to (intended) limitations of the model of reactive Turing machines. That is, the pi-calculus allows the specification of behaviour that is not executable up to divergence-preserving branching bisimilarity. Motivated by an intuitive understanding of executability, we then consider a restriction on the operational semantics of the pi-calculus that does associate with every pi-term executable behaviour, at least up to the version of branching bisimilarity that does not require the preservation of divergence.

preprint2015arXiv

Joint time and frequency dissemination network over delay-stabilized fiber optic links

A precise fiber-based time and frequency dissemination scheme for multiple users with a tree-like branching topology is proposed. Through this scheme, ultra-stable signals can be easily accessed online anywhere along the fiber without affecting other sites. The scheme is tested through an experiment, in which a modulated frequency signal and a synchronized time signal are transferred to multiple remote sites over a delay-stabilized fiber optic links that are over 50 km long. Results show that the relative stabilities are 5E-14@1s and 2E-17@10000s. Meanwhile, compared with each site, time synchronization precision is less than 80 ps. These results can pave the way to practical applications in joint time and frequency dissemination network systems.

preprint2015arXiv

Quasisymmetric geometry of the Cantor circles as the Julia sets of rational maps

We give three families of parabolic rational maps and show that every Cantor set of circles as the Julia set of a non-hyperbolic rational map must be quasisymmetrically equivalent to the Julia set of one map in these families for suitable parameters. Combining a result obtained before, we give a complete classification of the Cantor circles Julia sets in the sense of quasisymmetric equivalence. Moreover, we study the regularity of the components of the Cantor circles Julia sets and establish a sufficient and necessary condition when a component of a Cantor circles Julia set is a quasicircle.

preprint2014arXiv

Deep Poselets for Human Detection

We address the problem of detecting people in natural scenes using a part approach based on poselets. We propose a bootstrapping method that allows us to collect millions of weakly labeled examples for each poselet type. We use these examples to train a Convolutional Neural Net to discriminate different poselet types and separate them from the background class. We then use the trained CNN as a way to represent poselet patches with a Pose Discriminative Feature (PDF) vector -- a compact 256-dimensional feature vector that is effective at discriminating pose from appearance. We train the poselet model on top of PDF features and combine them with object-level CNNs for detection and bounding box prediction. The resulting model leads to state-of-the-art performance for human detection on the PASCAL datasets.

preprint2013arXiv

Adaptive low rank and sparse decomposition of video using compressive sensing

We address the problem of reconstructing and analyzing surveillance videos using compressive sensing. We develop a new method that performs video reconstruction by low rank and sparse decomposition adaptively. Background subtraction becomes part of the reconstruction. In our method, a background model is used in which the background is learned adaptively as the compressive measurements are processed. The adaptive method has low latency, and is more robust than previous methods. We will present experimental results to demonstrate the advantages of the proposed method.

preprint2013arXiv

Characteristics Analysis and State Transfer for non-Markovian Open Quantum Systems

The weak-coupled two-level open quantum system described by non-Markovian Time-convolution-less master equation is investigated in this paper. The cut-off frequency, coupling constant and transition frequency, which impact on the system's decay rate, coherence factor and purity, are investigated. The appropriate parameters used in system simulation experiments are determined by comparing analysis results of different values of parameters for the effects of system performance. The control laws used to transfer the system states are designed on the basis of the Lyapunov stability theorem. Numerical simulation experiments are implemented under the MATLAB environment. The features of the free evolution trajectory of the non-Markovian systems and the states transfer from a pure state to a desired pure state under the action of the proposed control laws are studied, respectively. By comparing the experimental results, the effectiveness of the proposed quantum Lyapunov control method applied to the state transfer in non-Markovian open quantum systems is verified. Meanwhile, the influences of different control parameters and cut-off frequencies on the system performance are analyzed.

preprint2013arXiv

Face Recognition via Globality-Locality Preserving Projections

We present an improved Locality Preserving Projections (LPP) method, named Gloablity-Locality Preserving Projections (GLPP), to preserve both the global and local geometric structures of data. In our approach, an additional constraint of the geometry of classes is imposed to the objective function of conventional LPP for respecting some more global manifold structures. Moreover, we formulate a two-dimensional extension of GLPP (2D-GLPP) as an example to show how to extend GLPP with some other statistical techniques. We apply our works to face recognition on four popular face databases, namely ORL, Yale, FERET and LFW-A databases, and extensive experimental results demonstrate that the considered global manifold information can significantly improve the performance of LPP and the proposed face recognition methods outperform the state-of-the-arts.

preprint2013arXiv

On the dynamics of a family of renormalization transformations

We study the family of renormalization transformations of the generalized $d$--dimensional diamond hierarchical Potts model in statistical mechanic and prove that their Julia sets and non-escaping loci are always connected, where $d\geq 2$. In particular, we prove that their Julia sets can never be a Sierpiński carpet if the parameter is real. We show that the Julia set is a quasicircle if and only if the parameter lies in the unbounded capture domain of these models. Moreover, the asymptotic formula of the Hausdorff dimension of the Julia set is calculated as the parameter tends to infinity.

preprint2012arXiv

Efficient and Effective Volume Visualization with Enhanced Isosurface Rendering

Compared with full volume rendering, isosurface rendering has several well recognized advantages in efficiency and accuracy. However, standard isosurface rendering has some limitations in effectiveness. First, it uses a monotone colored approach and can only visualize the geometry features of an isosurface. The lack of the capability to illustrate the material property and the internal structures behind an isosurface has been a big limitation of this method in applications. Another limitation of isosurface rendering is the difficulty to reveal physically meaningful structures, which are hidden in one or multiple isosurfaces. As such, the application requirements of extract and recombine structures of interest can not be implemented effectively with isosurface rendering. In this work, we develop an enhanced isosurface rendering technique to improve the effectiveness while maintaining the performance efficiency of the standard isosurface rendering. First, an isosurface color enhancement method is proposed to illustrate the neighborhood density and to reveal some of the internal structures. Second, we extend the structure extraction capability of isosurface rendering by enabling explicit scene exploration within a 3D-view, using surface peeling, voxel-selecting, isosurface segmentation, and multi-surface-structure visualization. Our experiments show that the color enhancement not only improves the visual fidelity of the rendering, but also reveals the internal structures without significant increase of the computational cost. Explicit scene exploration is also demonstrated as a powerful tool in some application scenarios, such as displaying multiple abdominal organs.