BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Nikolay Malkin

Nikolay Malkin appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Machine LearningComputer VisionArtificial IntelligenceComputation and Languagemath.AG

Catalog footprint

What is connected

6works
5topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

6 published item(s)

preprint2023arXiv

Diffusion models as plug-and-play priors

We consider the problem of inferring high-dimensional data $\mathbf{x}$ in a model that consists of a prior $p(\mathbf{x})$ and an auxiliary differentiable constraint $c(\mathbf{x},\mathbf{y})$ on $x$ given some additional information $\mathbf{y}$. In this paper, the prior is an independently trained denoising diffusion generative model. The auxiliary constraint is expected to have a differentiable form, but can come from diverse sources. The possibility of such inference turns diffusion models into plug-and-play modules, thereby allowing a range of potential applications in adapting models to new domains and tasks, such as conditional generation or image segmentation. The structure of diffusion models allows us to perform approximate inference by iterating differentiation through the fixed denoising network enriched with different amounts of noise at each step. Considering many noised versions of $\mathbf{x}$ in evaluation of its fitness is a novel search mechanism that may lead to new algorithms for solving combinatorial optimization problems.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Coherence boosting: When your pretrained language model is not paying enough attention

Long-range semantic coherence remains a challenge in automatic language generation and understanding. We demonstrate that large language models have insufficiently learned the effect of distant words on next-token prediction. We present coherence boosting, an inference procedure that increases a LM's focus on a long context. We show the benefits of coherence boosting with pretrained models by distributional analyses of generated ordinary text and dialog responses. It is also found that coherence boosting with state-of-the-art models for various zero-shot NLP tasks yields performance gains with no additional training.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Generative Flow Networks for Discrete Probabilistic Modeling

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a stochastic data construction policy and thus amortize expensive MCMC exploration into a fixed number of actions sampled from a GFlowNet. We show how GFlowNets can approximately perform large-block Gibbs sampling to mix between modes. We propose a framework to jointly train a GFlowNet with an energy function, so that the GFlowNet learns to sample from the energy distribution, while the energy learns with an approximate MLE objective with negative samples from the GFlowNet. We demonstrate EB-GFN's effectiveness on various probabilistic modeling tasks. Code is publicly available at https://github.com/zdhNarsil/EB_GFN.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Resolving label uncertainty with implicit posterior models

We propose a method for jointly inferring labels across a collection of data samples, where each sample consists of an observation and a prior belief about the label. By implicitly assuming the existence of a generative model for which a differentiable predictor is the posterior, we derive a training objective that allows learning under weak beliefs. This formulation unifies various machine learning settings; the weak beliefs can come in the form of noisy or incomplete labels, likelihoods given by a different prediction mechanism on auxiliary input, or common-sense priors reflecting knowledge about the structure of the problem at hand. We demonstrate the proposed algorithms on diverse problems: classification with negative training examples, learning from rankings, weakly and self-supervised aerial imagery segmentation, co-segmentation of video frames, and coarsely supervised text classification.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

High-resolution land cover change from low-resolution labels: Simple baselines for the 2021 IEEE GRSS Data Fusion Contest

We present simple algorithms for land cover change detection in the 2021 IEEE GRSS Data Fusion Contest. The task of the contest is to create high-resolution (1m / pixel) land cover change maps of a study area in Maryland, USA, given multi-resolution imagery and label data. We study several baseline models for this task and discuss directions for further research. See https://dfc2021.blob.core.windows.net/competition-data/dfc2021_index.txt for the data and https://github.com/calebrob6/dfc2021-msd-baseline for an implementation of these baselines.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Shuffle relations for Hodge and motivic correlators

The Hodge correlators ${\rm Cor}_{\mathcal H}(z_0,z_1,\dots,z_n)$ are functions of several complex variables, defined by Goncharov (arXiv:0803.0297) by an explicit integral formula. They satisfy some linear relations: dihedral symmetry relations, distribution relations, and shuffle relations. We found new second shuffle relations. When $z_i\in0\cupμ_N$, where $μ_N$ are the $N$-th roots of unity, they are expected to give almost all relations. When $z_i$ run through a finite subset $S$ of $\mathbb C$, the Hodge correlators describe the real mixed Hodge-Tate structure on the pronilpotent completion of the fundamental group $π_1^{\rm nil}(\mathbb{CP}^1-(S\cup\infty),v_\infty)$, a Lie algebra in the category of mixed $\mathbb Q$-Hodge-Tate structures. The Hodge correlators are lifted to canonical elements ${\rm Cor_{Hod}}(z_0,\dots,z_n)$ in the Tannakian Lie coalgebra of this category. We prove that these elements satisfy the second shuffle relations. Let $S\subset\overline{\mathbb Q}$. The pronilpotent fundamental group is the Betti realization of the motivic fundamental group, a Lie algebra in the category of mixed Tate motives over $\overline{\mathbb Q}$. The Hodge correlators are lifted to elements ${\rm Cor_{Mot}}(z_0,\dots,z_n)$ in its Tannakian Lie coalgebra $\rm Lie_{MT}^\vee$. We prove the second shuffle relations for these motivic elements. The universal enveloping algebra of $\rm Lie_{MT}^\vee$ was described by Goncharov via motivic multiple polylogarithms, which obey a similar yet different set of double shuffle relations. Motivic correlators have several advantages: they obey dihedral symmetry relations at all points, not only at roots of unity; they are defined for any curve, and the double shuffle relations admit a generalization to elliptic curves; and they describe elements of the motivic Lie coalgebra rather than its universal enveloping algebra.

0 citations0 reviewsNo code linkedOpen access