BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Léo Dreyfus-Schmidt

Léo Dreyfus-Schmidt appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Machine Learningmath.RTmath.AG

Catalog footprint

What is connected

5works
3topics
3close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

5 published item(s)

preprint2022arXiv

Performance Prediction Under Dataset Shift

ML models deployed in production often have to face unknown domain changes, fundamentally different from their training settings. Performance prediction models carry out the crucial task of measuring the impact of these changes on model performance. We study the generalization capabilities of various performance prediction models to new domains by learning on generated synthetic perturbations. Empirical validation on a benchmark of ten tabular datasets shows that models based upon state-of-the-art shift detection metrics are not expressive enough to generalize to unseen domains, while Error Predictors bring a consistent improvement in performance prediction under shift. We additionally propose a natural and effortless uncertainty estimation of the predicted accuracy that ensures reliable use of performance predictors. Our implementation is available at https: //github.com/dataiku-research/performance_prediction_under_shift.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Towards Clear Expectations for Uncertainty Estimation

If Uncertainty Quantification (UQ) is crucial to achieve trustworthy Machine Learning (ML), most UQ methods suffer from disparate and inconsistent evaluation protocols. We claim this inconsistency results from the unclear requirements the community expects from UQ. This opinion paper offers a new perspective by specifying those requirements through five downstream tasks where we expect uncertainty scores to have substantial predictive power. We design these downstream tasks carefully to reflect real-life usage of ML models. On an example benchmark of 7 classification datasets, we did not observe statistical superiority of state-of-the-art intrinsic UQ methods against simple baselines. We believe that our findings question the very rationale of why we quantify uncertainty and call for a standardized protocol for UQ evaluation based on metrics proven to be relevant for the ML practitioner.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Rebuilding Trust in Active Learning with Actionable Metrics

Active Learning (AL) is an active domain of research, but is seldom used in the industry despite the pressing needs. This is in part due to a misalignment of objectives, while research strives at getting the best results on selected datasets, the industry wants guarantees that Active Learning will perform consistently and at least better than random labeling. The very one-off nature of Active Learning makes it crucial to understand how strategy selection can be carried out and what drives poor performance (lack of exploration, selection of samples that are too hard to classify, ...). To help rebuild trust of industrial practitioners in Active Learning, we present various actionable metrics. Through extensive experiments on reference datasets such as CIFAR100, Fashion-MNIST, and 20Newsgroups, we show that those metrics brings interpretability to AL strategies that can be leveraged by the practitioner.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Splendid and perverse equivalences

Inspired by the works of Rickard on splendid equivalences and of Chuang and Rouquier on perverse equivalences, we are here interested in the combination of both, a splendid perverse equivalence. This is naturally the right framework to understand the relations between global and local perverse equivalences between blocks of finite groups, as a splendid equivalence induces local derived equivalences via the Brauer functor. We prove that under certain conditions, we have an equivalence between a perverse equivalence between the homotopy category of p-permutation modules and local derived perverse equivalences, in the case of abelian defect group.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Stability conditions on Brauer tree algebras

We study the space of stability conditions attached to the derived category of $A_{n}$-mod for $A_{n}$ the Brauer tree algebra of the line with $n$ edges. These algebras arise in the study of cyclic defect blocks of group algebras, and they are also related to the zig-zag algebras introduced by Huerfano and Khovanov. We show that for the Brauer tree algebra $A_{3}$, the connected component of the natural heart of the space of stability conditions is simply connected. However, unlike certains examples arising in geometry, the Bridgeland homomorphism is not a covering map.

0 citations0 reviewsNo code linkedOpen access