Researcher profile

Vincent Adam

Vincent Adam contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 17 - UnverifiedVerification L1Unclaimed author
4works
0followers
3topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

4 published item(s)

preprint2022arXiv

Dual Parameterization of Sparse Variational Gaussian Processes

Sparse variational Gaussian process (SVGP) methods are a common choice for non-conjugate Gaussian process inference because of their computational benefits. In this paper, we improve their computational efficiency by using a dual parameterization where each data example is assigned dual parameters, similarly to site parameters used in expectation propagation. Our dual parameterization speeds-up inference using natural gradient descent, and provides a tighter evidence lower bound for hyperparameter learning. The approach has the same memory cost as the current SVGP methods, but it is faster and more accurate.

preprint2020arXiv

A Framework for Interdomain and Multioutput Gaussian Processes

One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to improve the utility of GPs we need a modular system that allows rapid implementation and testing, as seen in the neural network community. We present a mathematical and software framework for scalable approximate inference in GPs, which combines interdomain approximations and multiple outputs. Our framework, implemented in GPflow, provides a unified interface for many existing multioutput models, as well as more recent convolutional structures. This simplifies the creation of deep models with GPs, and we hope that this work will encourage more interest in this approach.

preprint2020arXiv

Doubly Sparse Variational Gaussian Processes

The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the variational sparse approximation which relies on inducing points and 2) the state-space equivalent formulation of Gaussian processes which can be seen as exploiting some sparsity in the precision matrix. We propose to take the best of both worlds: we show that the inducing point framework is still valid for state space models and that it can bring further computational and memory savings. Furthermore, we provide the natural gradient formulation for the proposed variational parameterisation. Finally, this work makes it possible to use the state-space formulation inside deep Gaussian process models as illustrated in one of the experiments.

preprint2020arXiv

Non-linear regression models for behavioral and neural data analysis

Regression models are popular tools in empirical sciences to infer the influence of a set of variables onto a dependent variable given an experimental dataset. In neuroscience and cognitive psychology, Generalized Linear Models (GLMs) -including linear regression, logistic regression, and Poisson GLM- is the regression model of choice to study the factors that drive participant's choices, reaction times and neural activations. These methods are however limited as they only capture linear contributions of each regressors. Here, we introduce an extension of GLMs called Generalized Unrestricted Models (GUMs), which allows to infer a much richer set of contributions of the regressors to the dependent variable, including possible interactions between the regressors. In a GUM, each regressor is passed through a linear or nonlinear function, and the contribution of the different resulting transformed regressors can be summed or multiplied to generate a predictor for the dependent variable. We propose a Bayesian treatment of these models in which we endow functions with Gaussian Process priors, and we present two methods to compute a posterior over the functions given a dataset: the Laplace method and a sparse variational approach, which scales better for large dataset. For each method, we assess the quality of the model estimation and we detail how the hyperparameters (defining for example the expected smoothness of the function) can be fitted. Finally, we illustrate the power of the method on a behavioral dataset where subjects reported the average perceived orientation of a series of gratings. The method allows to recover the mapping of the grating angle onto perceptual evidence for each subject, as well as the impact of the grating based on its position. Overall, GUMs provides a very rich and flexible framework to run nonlinear regression analysis in neuroscience, psychology, and beyond.