Source author record

Olivier Tieleman

Olivier Tieleman appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

cond-mat.quant-gas Artificial Intelligence Machine Learning Computation and Language cond-mat.str-el

Catalog footprint

What is connected

6works

5topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2021arXiv

Formalising Concepts as Grounded Abstractions

The notion of concept has been studied for centuries, by philosophers, linguists, cognitive scientists, and researchers in artificial intelligence (Margolis & Laurence, 1999). There is a large literature on formal, mathematical models of concepts, including a whole sub-field of AI -- Formal Concept Analysis -- devoted to this topic (Ganter & Obiedkov, 2016). Recently, researchers in machine learning have begun to investigate how methods from representation learning can be used to induce concepts from raw perceptual data (Higgins, Sonnerat, et al., 2018). The goal of this report is to provide a formal account of concepts which is compatible with this latest work in deep learning. The main technical goal of this report is to show how techniques from representation learning can be married with a lattice-theoretic formulation of conceptual spaces. The mathematics of partial orders and lattices is a standard tool for modelling conceptual spaces (Ch.2, Mitchell (1997), Ganter and Obiedkov (2016)); however, there is no formal work that we are aware of which defines a conceptual lattice on top of a representation that is induced using unsupervised deep learning (Goodfellow et al., 2016). The advantages of partially-ordered lattice structures are that these provide natural mechanisms for use in concept discovery algorithms, through the meets and joins of the lattice.

preprint2020arXiv

Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning

We present a method for combining multi-agent communication and traditional data-driven approaches to natural language learning, with an end goal of teaching agents to communicate with humans in natural language. Our starting point is a language model that has been trained on generic, not task-specific language data. We then place this model in a multi-agent self-play environment that generates task-specific rewards used to adapt or modulate the model, turning it into a task-conditional language model. We introduce a new way for combining the two types of learning based on the idea of reranking language model samples, and show that this method outperforms others in communicating with humans in a visual referential communication task. Finally, we present a taxonomy of different types of language drift that can occur alongside a set of measures to detect them.

preprint2020arXiv

Never Give Up: Learning Directed Exploration Strategies

We propose a reinforcement learning agent to solve hard exploration games by learning a range of directed exploratory policies. We construct an episodic memory-based intrinsic reward using k-nearest neighbors over the agent's recent experience to train the directed exploratory policies, thereby encouraging the agent to repeatedly revisit all states in its environment. A self-supervised inverse dynamics model is used to train the embeddings of the nearest neighbour lookup, biasing the novelty signal towards what the agent can control. We employ the framework of Universal Value Function Approximators (UVFA) to simultaneously learn many directed exploration policies with the same neural network, with different trade-offs between exploration and exploitation. By using the same neural network for different degrees of exploration/exploitation, transfer is demonstrated from predominantly exploratory policies yielding effective exploitative policies. The proposed method can be incorporated to run with modern distributed RL agents that collect large amounts of experience from many actors running in parallel on separate environment instances. Our method doubles the performance of the base agent in all hard exploration in the Atari-57 suite while maintaining a very high score across the remaining games, obtaining a median human normalised score of 1344.0%. Notably, the proposed method is the first algorithm to achieve non-zero rewards (with a mean score of 8,400) in the game of Pitfall! without using demonstrations or hand-crafted features.

preprint2013arXiv

Spontaneous time-reversal symmetry breaking for spinless fermions on a triangular lattice

As a minimal fermionic model with kinetic frustration, we study a system of spinless fermions in the lowest band of a triangular lattice with long-range repulsion. We find that the combination of interactions and kinetic frustration leads to spontaneous symmetry breaking in various ways. Time-reversal symmetry can be broken by two types of loop current patterns, a chiral one and one that breaks the translational lattice symmetry. Moreover, the translational symmetry can also be broken by a density wave forming a kagome pattern or by a Peierls-type trimerization characterized by enhanced correlations among the sites of certain triangular plaquettes (giving a plaquette-centered density wave). We map out the phase diagram as it results from leading order Ginzburg-Landau mean-field theory. Several experimental realizations of the type of system under study are possible with ultracold atoms in optical lattices.

preprint2012arXiv

Non-Abelian gauge fields and topological insulators in shaken optical lattices

Time-periodic driving like lattice shaking offers a low-demanding method to generate artificial gauge fields in optical lattices. We identify the relevant symmetries that have to be broken by the driving function for that purpose and demonstrate the power of this method by making concrete proposals for its application to two-dimensional lattice systems: We show how to tune frustration and how to create and control band touching points like Dirac cones in the shaken kagomé lattice. We propose the realization of a topological and a quantum spin Hall insulator in a shaken spin-dependent hexagonal lattice. We describe how strong artificial magnetic fields can be achieved for example in a square lattice by employing superlattice modulation. Finally, exemplified on a shaken spin-dependent square lattice, we develop a method to create strong non-Abelian gauge fields.

preprint2011arXiv

Strongly interacting bosons in a 1D optical lattice at incommensurate densities

We investigate quantum phase transitions occurring in a system of strongly interacting ultracold bosons in a 1D optical lattice. After discussing the commensurate-incommensurate transition, we focus on the phases appearing at incommensurate filling. We find a rich phase diagram, with superfluid, supersolid and solid (kink-lattice) phases. Supersolids generally appear in theoretical studies of systems with long-range interactions; our results break this paradigm and show that they may also emerge in models including only short-range (contact) interactions, provided that quantum fluctuations are properly taken into account.