Source author record

Yating Liu

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

math.PR Artificial Intelligence Computer Vision math.ST Statistics Theory

Catalog footprint

Research overview

4works

5topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2024arXiv

CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval

Text-based Person Retrieval (TPR) aims to retrieve the target person images given a textual query. The primary challenge lies in bridging the substantial gap between vision and language modalities, especially when dealing with limited large-scale datasets. In this paper, we introduce a CLIP-based Synergistic Knowledge Transfer (CSKT) approach for TPR. Specifically, to explore the CLIP's knowledge on input side, we first propose a Bidirectional Prompts Transferring (BPT) module constructed by text-to-image and image-to-text bidirectional prompts and coupling projections. Secondly, Dual Adapters Transferring (DAT) is designed to transfer knowledge on output side of Multi-Head Attention (MHA) in vision and language. This synergistic two-way collaborative mechanism promotes the early-stage feature fusion and efficiently exploits the existing knowledge of CLIP. CSKT outperforms the state-of-the-art approaches across three benchmark datasets when the training parameters merely account for 7.4% of the entire model, demonstrating its remarkable efficiency, effectiveness and generalization.

preprint2022arXiv

Functional convex order for the scaled McKean-Vlasov processes

We establish the functional convex order results for two scaled McKean-Vlasov processes $X=(X_{t})_{t\in[0, T]}$ and $Y=(Y_{t})_{t\in[0, T]}$ defined on a filtered probability space $(Ω, \mathcal{F}, (\mathcal{F}_{t})_{t\geq0}, \mathbb{P})$ by $\begin{cases} dX_{t}= b(t, X_{t}, μ_{t})dt+σ(t, X_{t}, μ_{t})dB_{t}, \;\;X_{0}\in L^{p}(\mathbb{P}),\\ dY_{t}\,= b(t, \,Y_{t}\,,\, ν_{t})dt+θ(t, \,Y_{t}\,,\, ν_{t})dB_{t}, \;\;Y_{0}\in L^{p}(\mathbb{P}), \end{cases}$ where $p\geq2$ , for every $t\in[0, T]$ , $μ_t$ , $ν_t$ denote the probability distribution of $X_t$ , $Y_t$ respectively and the drift coefficient $b(t, x, μ)$ is affine in $x$ (scaled). If we make the convexity and monotony assumption (only) on $σ$ and if $σ\preceqθ$ with respect to the partial matrix order, the convex order for the initial random variable $X_0 \preceq_{\,cv} Y_0$ can be propagated to the whole path of process $X$ and $Y$ . That is, if we consider a convex functional $F$ defined on the path space with polynomial growth, we have $\mathbb{E}F(X)\leq\mathbb{E}F(Y)$ ; for a convex functional $G$ defined on the product space involving the path space and its marginal distribution space, we have $\mathbb{E}\,G\big(X, (μ_t)_{t\in[0, T]}\big)\leq \mathbb{E}\,G\big(Y, (ν_t)_{t\in[0, T]}\big)$ under appropriate conditions. The symmetric setting is also valid, that is, if $θ\preceq σ$ and $Y_0 \leq X_0$ with respect to the convex order, then $\mathbb{E}\,F(Y) \leq \mathbb{E}\,F(X)$ and $\mathbb{E}\,G\big(Y, (ν_t)_{t\in[0, T]}\big)\leq \mathbb{E}\,G(X, (μ_t)_{t\in[0, T]})$ . The proof is based on several forward and backward dynamic programming principles and the convergence of the Euler scheme of the McKean-Vlasov equation.

preprint2020arXiv

Convergence rate of optimal quantization grids and application to empirical measure

We study the convergence rate of the optimal quantization for a probability measure sequence $(μ_{n})_{n\in\mathbb{N}^{*}}$ on $\mathbb{R}^{d}$ converging in the Wasserstein distance in two aspects: the first one is the convergence rate of optimal quantizer $x^{(n)}\in(\mathbb{R}^{d})^{K}$ of $μ_{n}$ at level $K$ ; the other one is the convergence rate of the distortion function valued at $x^{(n)}$ , called the "performance" of $x^{(n)}$ . Moreover, we also study the mean performance of the optimal quantization for the empirical measure of a distribution $μ$ with finite second moment but possibly unbounded support. As an application, we show that the mean performance for the empirical measure of the multidimensional normal distribution $\mathcal{N}(m, Σ)$ and of distributions with hyper-exponential tails behave like $\mathcal{O}(\frac{\log n}{\sqrt{n}})$ . This extends the results from [BDL08] obtained for compactly supported distribution. We also derive an upper bound which is sharper in the quantization level $K$ but suboptimal in $n$ by applying results in [FG15].

preprint2019arXiv

Characterization of probability distribution convergence in Wasserstein distance by $L^{p}$ -quantization error function

We establish conditions to characterize probability measures by their $L^{p}$ -quantization error functions in both $\mathbb{R}^{d}$ and Hilbert settings. This characterization is two-fold: static (identity of two distributions) and dynamic (convergence for the $L^p$ -Wasserstein distance). We first propose a criterion on the quantization level $N$ , valid for any norm on $\mathbb{R}^{d}$ and any order $p$ based on a geometrical approach involving the Voronoï diagram. Then, we prove that in the $L^2$ -case on a (separable) Hilbert space, the condition on the level $N$ can be reduced to $N=2$ , which is optimal. More quantization based characterization cases on dimension 1 and a discussion of the completeness of a distance defined by the quantization error function can be found in the end of this paper.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Yating Liu

Research overview

Is this your work?

4 publications

CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval

Functional convex order for the scaled McKean-Vlasov processes

Convergence rate of optimal quantization grids and application to empirical measure

Characterization of probability distribution convergence in Wasserstein distance by $L^{p}$ -quantization error function

See the researcher in context

Building this map preview

Yating Liu

Research overview

Is this your work?

4 publications

CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval

Functional convex order for the scaled McKean-Vlasov processes

Convergence rate of optimal quantization grids and application to empirical measure

Characterization of probability distribution convergence in Wasserstein distance by LpL^{p}Lp-quantization error function

See the researcher in context

Building this map preview

Characterization of probability distribution convergence in Wasserstein distance by $L^{p}$ -quantization error function