Source author record

Qing Jin

Qing Jin appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Computer Vision Machine Learning Neural and Evolutionary Computing physics.soc-ph Artificial Intelligence Hardware Architecture math.OC Social and Information Networks

Catalog footprint

What is connected

5works

8topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization

Neural network quantization is a promising compression technique to reduce memory footprint and save energy consumption, potentially leading to real-time inference. However, there is a performance gap between quantized and full-precision models. To reduce it, existing quantization approaches require high-precision INT32 or full-precision multiplication during inference for scaling or dequantization. This introduces a noticeable cost in terms of memory, speed, and required energy. To tackle these issues, we present F8Net, a novel quantization framework consisting of only fixed-point 8-bit multiplication. To derive our method, we first discuss the advantages of fixed-point multiplication with different formats of fixed-point numbers and study the statistical behavior of the associated fixed-point numbers. Second, based on the statistical and algorithmic analysis, we apply different fixed-point formats for weights and activations of different layers. We introduce a novel algorithm to automatically determine the right format for each layer during training. Third, we analyze a previous quantization algorithm -- parameterized clipping activation (PACT) -- and reformulate it using fixed-point arithmetic. Finally, we unify the recently proposed method for quantization fine-tuning and our fixed-point approach to show the potential of our method. We verify F8Net on ImageNet for MobileNet V1/V2 and ResNet18/50. Our approach achieves comparable and better performance, when compared not only to existing quantization techniques with INT32 multiplication or floating-point arithmetic, but also to the full-precision counterparts, achieving state-of-the-art performance.

preprint2020arXiv

AdaBits: Neural Network Quantization with Adaptive Bit-Widths

Deep neural networks with adaptive configurations have gained increasing attention due to the instant and flexible deployment of these models on platforms with different resource budgets. In this paper, we investigate a novel option to achieve this goal by enabling adaptive bit-widths of weights and activations in the model. We first examine the benefits and challenges of training quantized model with adaptive bit-widths, and then experiment with several approaches including direct adaptation, progressive training and joint training. We discover that joint training is able to produce comparable performance on the adaptive model as individual models. We further propose a new technique named Switchable Clipping Level (S-CL) to further improve quantized models at the lowest bit-width. With our proposed techniques applied on a bunch of models including MobileNet-V1/V2 and ResNet-50, we demonstrate that bit-width of weights and activations is a new option for adaptively executable deep neural networks, offering a distinct opportunity for improved accuracy-efficiency trade-off as well as instant adaptation according to the platform constraints in real-world applications.

preprint2020arXiv

ROC++: Robust Optimization in C++

Robust optimization is a very popular means to address decision-making problems affected by uncertainty. Its success has been fueled by its attractive robustness and scalability properties, by ease of modeling, and by the limited assumptions it needs about the uncertain parameters to yield meaningful solutions. Robust optimization techniques can address both single- and multi-stage decision-making problems involving real-valued and/or binary decisions, and exogenous and/or endogenous uncertain parameters. Many of these techniques apply to problems with either robust (worst-case) or stochastic (expectation) objectives and can thus be tailored to the risk preferences of the decision-maker. Robust optimization techniques rely on duality theory (potentially augmented with approximations) to transform a semi-infinite optimization problem to a finite program of benign complexity (the ``robust counterpart''). While writing down the model for a robust or stochastic optimization problem is usually a simple task, obtaining the robust counterpart requires expertise in robust optimization. To date, very few solutions are available that can facilitate the modeling and solution of such problems. This has been a major impediment to their being put to practical use. In this paper, we propose ROC++, a C++ based platform for automatic robust optimization, applicable to a wide array of single- and multi-stage stochastic and robust problems with both exogenous and endogenous uncertain parameters. We also propose the ROB file format that generalizes the LP file format to robust optimization. Our platform can help streamline the modeling and solution of stochastic and robust optimization problems for both researchers and practitioners. It comes with detailed documentation to facilitate its use and expansion. ROC++ is freely distributed for academic use.

preprint2012arXiv

Spontaneous Symmetry Breaking in Interdependent Networked Game

Spatial evolution game has traditionally assumed that players interact with neighbors on a single network, which is isolated and not influenced by other systems. We introduce the simple game model into the interdependent networks composed of two networks, and show that when the interdependent factor $α$ is smaller than a particular value $α_C$, homogeneous cooperation can be guaranteed. However, as interdependent factor exceeds $α_C$, spontaneous symmetry breaking of fraction of cooperators presents itself between different networks. In addition, our results can be well predicted by the strategy-couple pair approximation method.

preprint2011arXiv

Recorded punishment promotes cooperation in spatial prisoner's dilemma game

Previous studies suggest that punishment is a useful way to promote cooperation in the well-mixed public goods game, whereas it still lacks specific evidence that punishment maintains cooperation in spatial prisoner's dilemma game as well. To address this issue, we introduce a mechanism of recorded punishment, involved with memory and punishment, into spatial prisoner's dilemma game. We find that increasing punishment rate or memory length promotes the evolution of cooperation monotonously. Interestingly, compared with traditional version, recorded punishment will facilitate cooperation better through a recovery effect. Moreover, through examining the process of evolution, we provide an interpretation to this promotion phenomenon, namely, the recovery effect can be warranted by an evolution resonance of standard deviation of fitness coefficient. Finally, we confirm our results by studying the impact of uncertainty within strategy adoptions. We hope that our work may sharpen the understanding of the cooperative behavior in the society.