Source author record

Tyler Sypherd

Explore this author’s publications, collaborators and research topics. This catalog record has not been claimed by its author.

ResearcherUnclaimed source record

Machine Learning Artificial Intelligence Information Theory math.IT math.OC

Catalog footprint

Research overview

2works

5topics

4close collaborators

Actions

Is this your work?

Open graph Browse papers

preprint2022arXiv

$α$ -GAN: Convergence and Estimation Guarantees

We prove a two-way correspondence between the min-max optimization of general CPE loss function GANs and the minimization of associated $f$ -divergences. We then focus on $α$ -GAN, defined via the $α$ -loss, which interpolates several GANs (Hellinger, vanilla, Total Variation) and corresponds to the minimization of the Arimoto divergence. We show that the Arimoto divergences induced by $α$ -GAN equivalently converge, for all $α\in \mathbb{R}_{>0}\cup\{\infty\}$ . However, under restricted learning models and finite samples, we provide estimation bounds which indicate diverse GAN behavior as a function of $α$ . Finally, we present empirical results on a toy dataset that highlight the practical utility of tuning the $α$ hyperparameter.

preprint2022arXiv

Being Properly Improper

Properness for supervised losses stipulates that the loss function shapes the learning algorithm towards the true posterior of the data generating distribution. Unfortunately, data in modern machine learning can be corrupted or twisted in many ways. Hence, optimizing a proper loss function on twisted data could perilously lead the learning algorithm towards the twisted posterior, rather than to the desired clean posterior. Many papers cope with specific twists (e.g., label/feature/adversarial noise), but there is a growing need for a unified and actionable understanding atop properness. Our chief theoretical contribution is a generalization of the properness framework with a notion called twist-properness, which delineates loss functions with the ability to "untwist" the twisted posterior into the clean posterior. Notably, we show that a nontrivial extension of a loss function called $α$ -loss, which was first introduced in information theory, is twist-proper. We study the twist-proper $α$ -loss under a novel boosting algorithm, called PILBoost, and provide formal and experimental results for this algorithm. Our overarching practical conclusion is that the twist-proper $α$ -loss outperforms the proper $\log$ -loss on several variants of twisted data.

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Tyler Sypherd

Research overview

Is this your work?

2 publications

$α$ -GAN: Convergence and Estimation Guarantees

Being Properly Improper

See the researcher in context

Building this map preview

Tyler Sypherd

Research overview

Is this your work?

2 publications

ααα-GAN: Convergence and Estimation Guarantees

Being Properly Improper

See the researcher in context

Building this map preview

$α$ -GAN: Convergence and Estimation Guarantees